Jul 21 08:03:31 devstack cinder-volume[76352]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 08:03:31 devstack cinder-volume[76352]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 08:03:31 devstack cinder-volume[76352]: we strongly recommend against using it for new projects. Jul 21 08:03:31 devstack cinder-volume[76352]: If you are already using Eventlet, we recommend migrating to a different Jul 21 08:03:31 devstack cinder-volume[76352]: framework. For more detail see Jul 21 08:03:31 devstack cinder-volume[76352]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 08:03:31 devstack cinder-volume[76352]: import eventlet # noqa Jul 21 08:03:34 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:03:34 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:03:34 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:03:35 devstack cinder-volume[76352]: INFO dbcounter [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Registered counter for database cinder Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writer thread running {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:03:35 devstack cinder-volume[76352]: INFO cinder.rpc [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 08:03:35 devstack cinder-volume[76352]: INFO cinder.rpc [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:03:35 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Determined volume DB was empty at startup. Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76352) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 08:03:35 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 08:03:35 devstack cinder-volume[76352]: WARNING stevedore.named [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 08:03:35 devstack cinder-volume[76352]: WARNING castellan.key_manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:03:35 devstack cinder-volume[76352]: WARNING cinder.keymgr.conf_key_mgr [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76352) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 21 08:03:35 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] CMD "cinder-rtstool verify" returned: 0 in 0.465s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:03:36 devstack cinder-volume[76352]: INFO cinder.rpc [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 21 08:03:36 devstack cinder-volume[76352]: INFO cinder.rpc [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 21 08:03:36 devstack cinder-volume[76352]: WARNING stevedore.named [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 08:03:36 devstack cinder-volume[76352]: WARNING castellan.key_manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:03:36 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:03:36 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Starting 1 workers Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Started child 76502 {{(pid=76352) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Full set of CONF: {{(pid=76352) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] ******************************************************************************** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Configuration options gathered from: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] ================================================================================ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] allow_availability_zone_fallback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] allow_compression_on_image_upload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] allowed_direct_url_schemes = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] api_rate_limit = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] auth_strategy = keystone {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] az_cache_duration = 3600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_host = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_stats_polling_interval = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backup_api_class = cinder.backup.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backup_name_template = backup-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backup_use_same_host = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backup_use_temp_snapshot = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] chap_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76502]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_internal_tenant_project_id = eae782d1e8f242efbfb5aed77460c50a {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_internal_tenant_user_id = 5e02d8b147ef4e6c838e320e15f30ce5 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cloned_volume_same_az = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cluster = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] compression_format = gzip {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] compute_api_class = cinder.compute.nova.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] config_dir = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] config_source = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] control_exchange = openstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] debug = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] default_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] default_group_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] default_volume_type = lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_ssl_cert_verify = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] driver_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] enable_force_upload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] enable_new_services = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] enable_unsupported_driver = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] enabled_backends = ['lvmdriver-1'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] enforce_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_api_insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_api_ssl_compression = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_ca_certificates_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_catalog_info = image:glance:publicURL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_num_retries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance_request_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] graceful_shutdown_timeout = 5 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] group_api_class = cinder.group.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] host = devstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_compress_on_upload = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_conversion_address_space_limit = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_conversion_cpu_limit = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_conversion_disable = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_upload_use_cinder_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_upload_use_internal_tenant = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_volume_cache_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_volume_cache_max_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] image_volume_cache_max_size_gb = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] init_host_max_objects_retrieval = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] instance_format = [instance: %(uuid)s] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iscsi_target_flags = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iscsi_write_cache = on {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iser_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iser_ip_address = 192.168.122.140 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iser_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_color = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_config_append = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_options = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_rotate_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_rotate_interval_type = days {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] log_rotation_type = none {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] max_age = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] max_logfile_count = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] max_logfile_size_mb = 200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] max_over_subscription_ratio = 20.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] message_reap_interval = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] message_ttl = 2592000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] migration_create_volume_timeout_secs = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] monkey_patch = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] monkey_patch_modules = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] my_ip = 192.168.122.140 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] no_snapshot_gb_quota = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] num_iser_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] num_shell_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] num_volume_device_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] nvmeof_conn_info_version = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] nvmet_ns_id = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] nvmet_port_id = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_max_limit = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_ext_list = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_listen = 0.0.0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_listen_port = 8776 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] osapi_volume_workers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] per_volume_size_limit = -1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] periodic_fuzzy_delay = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] periodic_interval = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] project_id_regex = [0-9a-f\-]+ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] public_endpoint = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] publish_errors = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_backup_gigabytes = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_backups = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_gigabytes = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_groups = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_snapshots = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] quota_volumes = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] rate_limit_burst = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] rate_limit_except_level = CRITICAL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] rate_limit_interval = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] reinit_driver_count = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] report_discard_supported = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] report_interval = 120 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] reservation_clean_interval = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] reservation_expire = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] reserved_image_namespaces = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] reserved_percentage = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] rpc_response_timeout = 120 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] run_external_periodic_tasks = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] scst_target_driver = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_down_time = 720 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] shell_completion = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] snapshot_name_template = snapshot-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] snapshot_same_host = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] state_path = /opt/stack/data/cinder {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] storage_availability_zone = nova {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] storage_protocol = iSCSI {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] syslog_log_facility = LOG_USER {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_helper = lioadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_ip_address = 192.168.122.140 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] target_secondary_ip_addresses = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] transfer_api_class = cinder.transfer.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] transport_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] until_refresh = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_chap_auth = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_default_quota_class = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_journal = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_json = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_stderr = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] use_syslog = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] verify_glance_signatures = enabled {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_api_class = cinder.volume.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_clear_size = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_copy_bps_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_dd_blocksize = 1M {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_name_template = volume-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_service_inithost_offload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volume_usage_audit_period = month {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] zoning_mode = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_concurrency.disable_process_locking = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.auth_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.cache = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.delay_auth_decision = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.http_connect_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.include_service_catalog = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.interface = public {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_password = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcache_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.service_token_roles_required = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.service_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.token_cache_time = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.backend = dogpile.cache.null {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.backend_argument = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.backend_expiration_time = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.config_prefix = cache.oslo {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.debug_cache_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.enable_retry_client = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.enable_socket_keepalive = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.expiration_time = 600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.hashclient_retry_attempts = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_dead_retry = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_pool_maxsize = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_sasl_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.proxies = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.redis_db = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.redis_sentinel_service_name = mymaster {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.redis_server = localhost:6379 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.retry_attempts = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.retry_delay = 0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.socket_keepalive_count = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.socket_keepalive_idle = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.socket_keepalive_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.socket_timeout = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.tls_allowed_ciphers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.tls_cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.tls_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.tls_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.tls_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cache.username = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] coordination.backend_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.asyncio_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.asyncio_slave_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.backend = sqlalchemy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.connection_debug = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.connection_parameters = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.connection_recycle_time = 3600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.connection_trace = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.db_inc_retry_interval = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.db_max_retries = 20 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.db_max_retry_interval = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.db_retry_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.max_overflow = 50 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.max_pool_size = 5 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.max_retries = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.mysql_wsrep_sync_wait = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.pool_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.retry_interval = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.slave_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.sqlite_synchronous = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.synchronous_reader = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] database.use_db_reconnect = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.connection_string = messaging:// {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.es_doc_type = notification {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.es_scroll_size = 10000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.es_scroll_time = 2m {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.filter_error_trace = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.hmac_keys = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.sentinel_service_name = mymaster {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.socket_timeout = 0.1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.trace_requests = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler.trace_sqlalchemy = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler_jaeger.process_tags = {} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler_jaeger.service_name_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] profiler_otlp.service_name_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.enforce_new_defaults = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.policy_default_rule = default {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.policy_file = policy.yaml {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_policy.remote_timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.group = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.helper_command = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] privsep_osbrick.user = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.group = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.helper_command = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] cinder_sys_admin.user = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.send_service_user_token = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] service_user.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] glance.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.chap_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.driver_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.enable_unsupported_driver = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.extra_capabilities = {} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iscsi_target_flags = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iscsi_write_cache = on {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iser_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iser_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.lvm_mirrors = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.lvm_share_target = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.lvm_type = auto {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.num_shell_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.nvmet_port_id = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.report_discard_supported = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.reserved_percentage = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.scst_target_driver = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.storage_protocol = iSCSI {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.unique_fqdn_network = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.use_chap_auth = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_clear_size = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volume_group = cinder-volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_reports.file_event_handler = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_reports.log_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.backend_host = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.chap_username = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.chiscsi_conf = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.driver_use_ssl = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.extra_capabilities = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iser_helper = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iser_ip_address = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iser_port = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.iser_target_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.lvm_conf_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.lvm_mirrors = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.lvm_share_target = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.lvm_type = auto {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.num_shell_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.nvmet_port_id = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.report_discard_supported = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.reserved_percentage = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.scst_target_driver = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.storage_protocol = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_helper = lioadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_ip_address = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.use_chap_auth = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_clear_size = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] lvmdriver-1.volumes_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.ssl_version = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_notifications.driver = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_notifications.retry = -1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] oslo_messaging_notifications.transport_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] key_manager.fixed_key = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.barbican_api_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.barbican_endpoint = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.barbican_endpoint_type = public {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.barbican_region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.number_of_retries = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.retry_delay = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.send_service_user_token = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.verify_ssl = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican.verify_ssl_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.auth_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] barbican_service_user.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.approle_role_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.approle_secret_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.auth_method = approle {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.auth_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.kv_mountpoint = secret {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.kv_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.kv_version = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.root_token_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.ssl_ca_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.token_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.token_role = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:03:36 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] ******************************************************************************** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 08:03:36 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 21 08:03:36 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:36 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:36 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:36 devstack sudo[76660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:36 devstack sudo[76660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:37 devstack sudo[76660]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.265s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:03:37 devstack cinder-volume[76502]: INFO cinder.brick.local_dev.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:37 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:37 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:37 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG cinder.brick.local_dev.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76502) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:37 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:37 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:37 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:37 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:37 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:37 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:38 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:38 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 21 08:03:38 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:38 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.276s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:38 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:38 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:38 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:38 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:38 devstack sudo[77197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:38 devstack sudo[77197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:39 devstack sudo[77197]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:39 devstack sudo[77206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:39 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:39 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:39 devstack sudo[77289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:39 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:39 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:39 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:39 devstack sudo[77299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:39 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:40 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:40 devstack cinder-volume[76502]: INFO cinder.volume.drivers.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:40 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:40 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:40 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:40 devstack sudo[77306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:40 devstack sudo[77306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:40 devstack sudo[77306]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:40 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:40 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:40 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:40 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:40 devstack sudo[77312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:40 devstack sudo[77312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:41 devstack sudo[77312]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:41 devstack sudo[77315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:41 devstack sudo[77315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:41 devstack sudo[77315]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:41 devstack cinder-volume[76502]: INFO cinder.volume.driver [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Driver hasn't implemented _init_vendor_properties() Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG cinder.volume.driver [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76502) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_db.sqlalchemy.engines [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writer thread running {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG cinder.db.api [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Building query based on filter {{(pid=76502) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG cinder.image.image_utils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76502) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 08:03:41 devstack cinder-volume[76502]: INFO cinder.keymgr.migration [None req-1d88cf85-8777-4422-8c6b-52da92b4f29c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:41 devstack sudo[77321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:41 devstack sudo[77321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:41 devstack sudo[77321]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:41 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:41 devstack sudo[77324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:41 devstack sudo[77324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:42 devstack sudo[77324]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:42 devstack sudo[77327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:42 devstack sudo[77327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:42 devstack sudo[77327]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:42 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:42 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:42 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:03:42 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Driver initialization completed successfully. Jul 21 08:03:42 devstack cinder-volume[76502]: INFO cinder.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Initiating service 2 cleanup Jul 21 08:03:42 devstack cinder-volume[76502]: INFO cinder.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Service 2 cleanup completed. Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG cinder.service [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Creating RPC server for service cinder-volume {{(pid=76502) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG cinder.service [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76502) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 08:03:42 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:03:42 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:42 devstack sudo[77335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:03:42 devstack sudo[77335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:43 devstack sudo[77335]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:43 devstack sudo[77341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:43 devstack sudo[77341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:43 devstack sudo[77341]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:43 devstack sudo[77344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:03:43 devstack sudo[77344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:43 devstack sudo[77344]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:03:43 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:03:43 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:03:43 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Jul 21 08:03:43 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:03:43 devstack cinder-volume[76502]: INFO cinder.volume.manager [None req-3786ad1b-11e2-4679-9bc9-86583cc89abc None None] Driver post RPC initialization completed successfully. Jul 21 08:03:46 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:03:53 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:03:53 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:04:06 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:04:06 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:04:06 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread info: [<_MainThread(MainThread, started 127240202997888)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:05:06 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:05:06 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:05:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:05:06 devstack sudo[80012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:05:06 devstack sudo[80012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:05:07 devstack sudo[80012]: pam_unix(sudo:session): session closed for user root Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:05:07 devstack sudo[80015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:05:07 devstack sudo[80015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:05:07 devstack sudo[80015]: pam_unix(sudo:session): session closed for user root Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:05:07 devstack sudo[80026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:05:07 devstack sudo[80026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:05:07 devstack sudo[80026]: pam_unix(sudo:session): session closed for user root Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:05:07 devstack sudo[80029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:05:07 devstack sudo[80029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:05:07 devstack sudo[80029]: pam_unix(sudo:session): session closed for user root Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:05:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread info: [<_MainThread(MainThread, started 127240202997888)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:05:53 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:06:06 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:06:06 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:06:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:06:06 devstack sudo[83285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:06:06 devstack sudo[83285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:06:07 devstack sudo[83285]: pam_unix(sudo:session): session closed for user root Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:06:07 devstack sudo[83288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:06:07 devstack sudo[83288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:06:07 devstack sudo[83288]: pam_unix(sudo:session): session closed for user root Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:06:07 devstack sudo[83291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:06:07 devstack sudo[83291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:06:07 devstack sudo[83291]: pam_unix(sudo:session): session closed for user root Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:06:07 devstack sudo[83365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:06:07 devstack sudo[83365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:06:07 devstack sudo[83365]: pam_unix(sudo:session): session closed for user root Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:06:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread info: [<_MainThread(MainThread, started 127240202997888)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:07:06 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:07:06 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:07:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:07:06 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:07:06 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:07:07 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:07:07 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:07:07 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:07:07 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:07:07 devstack sudo[85264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:07:07 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:07:07 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:07:07 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:07:07 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:07:07 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager._thread_info {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread count: 6 {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:07:07 devstack cinder-volume[76502]: DEBUG cinder.volume.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] thread info: [<_MainThread(MainThread, started 127240202997888)>, , , , , ] {{(pid=76502) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:07:53 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:SELECT=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:07:53 devstack cinder-volume[76502]: DEBUG dbcounter [-] [76502] Writing DB stats cinder:UPDATE=1 {{(pid=76502) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:08:05 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Caught SIGTERM, stopping children Jul 21 08:08:05 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Acquiring lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:05 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Acquired lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:05 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Releasing lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:05 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Stop services. {{(pid=76352) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 08:08:05 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Killing children. {{(pid=76352) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 08:08:05 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Waiting on 1 children to exit Jul 21 08:08:06 devstack cinder-volume[76502]: DEBUG oslo_service.periodic_task [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76502) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:08:06 devstack cinder-volume[76502]: DEBUG cinder.volume.drivers.lvm [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Updating volume stats {{(pid=76502) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 21 08:08:06 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:06 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 21 08:08:06 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:07 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:07 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:08:07 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:07 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:07 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 21 08:08:07 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:07 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:07 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 21 08:08:07 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:07 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.processutils [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76502) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG cinder.manager [None req-5cd066e6-dab2-4312-b8b1-493bfa7050cd None None] Notifying Schedulers of capabilities ... {{(pid=76502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Acquiring lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Acquired lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:07 devstack cinder-volume[76502]: DEBUG oslo_concurrency.lockutils [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Releasing lock "singleton_lock" {{(pid=76502) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:07 devstack cinder-volume[76502]: WARNING amqp [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 08:08:08 devstack cinder-volume[76502]: WARNING amqp [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 08:08:08 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-ebd4badc-1e07-4d75-8703-0335c81ea4fc None None] Child 76502 exited with status 0 Jul 21 08:08:08 devstack cinder-volume[86612]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 08:08:08 devstack cinder-volume[86612]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 08:08:08 devstack cinder-volume[86612]: we strongly recommend against using it for new projects. Jul 21 08:08:08 devstack cinder-volume[86612]: If you are already using Eventlet, we recommend migrating to a different Jul 21 08:08:08 devstack cinder-volume[86612]: framework. For more detail see Jul 21 08:08:08 devstack cinder-volume[86612]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 08:08:08 devstack cinder-volume[86612]: import eventlet # noqa Jul 21 08:08:10 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:10 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:10 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:11 devstack cinder-volume[86612]: INFO dbcounter [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Registered counter for database cinder Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_db.sqlalchemy.engines [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG dbcounter [-] [86612] Writer thread running {{(pid=86612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:08:11 devstack cinder-volume[86612]: INFO cinder.rpc [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 08:08:11 devstack cinder-volume[86612]: INFO cinder.rpc [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_db.sqlalchemy.engines [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:11 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Determined volume DB was empty at startup. Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG cinder.volume.manager [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86612) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 08:08:11 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 21 08:08:11 devstack cinder-volume[86612]: WARNING stevedore.named [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 08:08:11 devstack cinder-volume[86612]: WARNING castellan.key_manager [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:08:11 devstack cinder-volume[86612]: WARNING cinder.keymgr.conf_key_mgr [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:08:11 devstack cinder-volume[86612]: INFO cinder.volume.manager [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_db.sqlalchemy.engines [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:11 devstack cinder-volume[86612]: INFO oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Starting 1 workers Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Started child 86827 {{(pid=86612) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Full set of CONF: {{(pid=86612) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] ******************************************************************************** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Configuration options gathered from: {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] ================================================================================ {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] allow_availability_zone_fallback = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] allow_compression_on_image_upload = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86827]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] allowed_direct_url_schemes = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] api_rate_limit = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] auth_strategy = keystone {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_availability_zone = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_host = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_stats_polling_interval = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backup_api_class = cinder.backup.api.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backup_name_template = backup-%s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backup_use_same_host = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backup_use_temp_snapshot = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] chap_password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] chap_username = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_internal_tenant_project_id = eae782d1e8f242efbfb5aed77460c50a {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_internal_tenant_user_id = 5e02d8b147ef4e6c838e320e15f30ce5 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cluster = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] compression_format = gzip {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] config_dir = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] config_source = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] control_exchange = openstack {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] debug = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] default_availability_zone = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] default_group_type = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] default_volume_type = QuobyteHD {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] disk_geometry = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_client_cert = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_client_cert_key = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_data_namespace = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_ssl_cert_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_ssl_cert_verify = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] driver_use_ssl = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] enable_new_services = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] enable_unsupported_driver = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] enforce_multipath_for_image_xfer = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] filter_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_api_insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_api_ssl_compression = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_ca_certificates_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_num_retries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance_request_timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] goodness_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] graceful_shutdown_timeout = 5 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] group_api_class = cinder.group.api.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] host = devstack {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_compress_on_upload = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_conversion_address_space_limit = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_conversion_cpu_limit = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_conversion_disable = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_upload_use_cinder_backend = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_upload_use_internal_tenant = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_volume_cache_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_volume_cache_max_count = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] init_host_max_objects_retrieval = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] instance_format = [instance: %(uuid)s] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iscsi_target_flags = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iscsi_write_cache = on {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iser_helper = tgtadm {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iser_ip_address = 192.168.122.140 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iser_port = 3260 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_color = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_config_append = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_dir = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_options = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_rotate_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_rotate_interval_type = days {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] log_rotation_type = none {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] max_age = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] max_logfile_count = 30 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] max_logfile_size_mb = 200 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] max_over_subscription_ratio = 20.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] message_reap_interval = 86400 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] message_ttl = 2592000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86827]: INFO cinder.volume.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Starting volume driver QuobyteDriver (1.2) Jul 21 08:08:11 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.remotefs [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86827) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] monkey_patch = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] monkey_patch_modules = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] my_ip = 192.168.122.140 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] no_snapshot_gb_quota = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] num_iser_scan_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] num_shell_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] num_volume_device_scan_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] nvmeof_conn_info_version = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] nvmet_ns_id = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] nvmet_port_id = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_max_limit = 1000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_ext_list = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_listen_port = 8776 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_use_ssl = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] osapi_volume_workers = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] per_volume_size_limit = -1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] periodic_fuzzy_delay = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] periodic_interval = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] public_endpoint = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] publish_errors = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_backup_gigabytes = 1000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_backups = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_gigabytes = 1000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_groups = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_snapshots = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] quota_volumes = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] rate_limit_burst = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] rate_limit_except_level = CRITICAL {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] rate_limit_interval = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] reinit_driver_count = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] replication_device = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] report_discard_supported = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] report_interval = 120 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] reservation_clean_interval = 86400 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] reservation_expire = 86400 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] reserved_image_namespaces = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] reserved_percentage = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] rpc_response_timeout = 120 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] run_external_periodic_tasks = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] scst_target_driver = iscsi {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] scst_target_iqn_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_down_time = 720 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] shell_completion = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] snapshot_name_template = snapshot-%s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] split_loggers = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] state_path = /opt/stack/data/cinder {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] storage_availability_zone = nova {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] storage_protocol = iSCSI {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] syslog_log_facility = LOG_USER {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_helper = lioadm {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_ip_address = 192.168.122.140 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_port = 3260 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_protocol = iscsi {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] target_secondary_ip_addresses = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] trace_flags = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] transport_url = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] until_refresh = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_chap_auth = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_default_quota_class = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_journal = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_json = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_multipath_for_image_xfer = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:11 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_stderr = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] use_syslog = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] verify_glance_signatures = enabled {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_api_class = cinder.volume.api.API {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_backend_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_clear = zero {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_clear_ionice = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_clear_size = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_copy_bps_limit = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_dd_blocksize = 1M {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_name_template = volume-%s {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_service_inithost_offload = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volume_usage_audit_period = month {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] zoning_mode = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.auth_section = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.auth_type = password {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.auth_version = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.cache = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.interface = public {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_password = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcache_username = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.region_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.service_type = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.backend = dogpile.cache.null {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.backend_argument = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.backend_expiration_time = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.config_prefix = cache.oslo {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.debug_cache_backend = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.enable_retry_client = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.enable_socket_keepalive = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.expiration_time = 600 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_dead_retry = 300 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_sasl_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.proxies = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.redis_db = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86827) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: WARNING cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.redis_server = localhost:6379 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: WARNING cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.retry_attempts = 2 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.retry_delay = 0.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.socket_keepalive_count = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.socket_keepalive_idle = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.socket_keepalive_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Running cmd (subprocess): mount.quobyte {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.socket_timeout = 1.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.tls_allowed_ciphers = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.tls_cafile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.tls_certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.tls_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.tls_keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cache.username = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] coordination.backend_url = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.asyncio_connection = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.asyncio_slave_connection = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.backend = sqlalchemy {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.connection = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.connection_debug = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.connection_parameters = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.connection_recycle_time = 3600 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.connection_trace = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.db_inc_retry_interval = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.db_max_retries = 20 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.db_max_retry_interval = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.db_retry_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.max_overflow = 50 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.max_pool_size = 5 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.max_retries = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.pool_timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.retry_interval = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.slave_connection = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.sqlite_synchronous = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.synchronous_reader = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] database.use_db_reconnect = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.connection_string = messaging:// {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.es_doc_type = notification {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.es_scroll_size = 10000 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.es_scroll_time = 2m {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.filter_error_trace = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.hmac_keys = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.sentinel_service_name = mymaster {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.socket_timeout = 0.1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.trace_requests = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler.trace_sqlalchemy = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler_jaeger.process_tags = {} {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] profiler_otlp.service_name_prefix = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.policy_default_rule = default {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.group = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.helper_command = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] privsep_osbrick.user = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.group = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.helper_command = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] cinder_sys_admin.user = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.auth_section = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.auth_type = password {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.cafile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.collect_timing = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.send_service_user_token = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.split_loggers = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] service_user.timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.auth_section = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.auth_type = password {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.collect_timing = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.region_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.split_loggers = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] glance.timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.backend_availability_zone = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.chap_password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.chap_username = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.disk_geometry = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_client_cert = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_data_namespace = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.driver_use_ssl = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack quobyte-client[86832]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.extra_capabilities = {} {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.filter_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.goodness_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack quobyte-client[86832]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iscsi_target_flags = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iser_port = 3260 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_host = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_login = admin {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=86827) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_mount_options = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_private_key = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_share_path = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: INFO cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 ... Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 -c /etc/quobyte/client-cinder.cfg {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.replication_device = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.report_discard_supported = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_helper = tgtadm {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_port = 3260 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_protocol = iscsi {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.trace_flags = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.use_chap_auth = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_backend_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_clear = zero {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_reports.file_event_handler = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_reports.log_dir = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.backend_host = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.chap_password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.chap_username = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.disk_geometry = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_client_cert = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.extra_capabilities = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.filter_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 -c /etc/quobyte/client-cinder.cfg Jul 21 08:08:12 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.goodness_function = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iser_helper = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iser_ip_address = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iser_port = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_host = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_login = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_mount_options = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_password = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_private_key = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_share_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.num_shell_tries = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.replication_device = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.report_discard_supported = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.reserved_percentage = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.scst_target_driver = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.storage_protocol = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_helper = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_ip_address = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_port = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_prefix = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_protocol = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.trace_flags = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.use_chap_auth = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_clear = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_clear_size = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] QuobyteHD.volumes_dir = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_notifications.driver = [] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] key_manager.fixed_key = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.barbican_api_version = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.barbican_endpoint = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.barbican_endpoint_type = public {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.barbican_region_name = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.cafile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.collect_timing = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.number_of_retries = 60 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.retry_delay = 1 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.send_service_user_token = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.split_loggers = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.verify_ssl = True {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican.verify_ssl_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.auth_section = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.auth_type = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.cafile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.certfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.collect_timing = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.insecure = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.keyfile = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.split_loggers = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] barbican_service_user.timeout = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.approle_role_id = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.approle_secret_id = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.auth_method = approle {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.auth_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.kv_mountpoint = secret {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.kv_path = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.kv_version = 2 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.namespace = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.root_token_id = **** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.ssl_ca_crt_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.timeout = 60.0 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.token_file = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.token_role = None {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.use_ssl = False {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:12 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] ******************************************************************************** {{(pid=86612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 08:08:12 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.447s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:12 devstack cinder-volume[86827]: INFO cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 succeeded Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=86827) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.466s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:12 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:12 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:12 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.282s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:12 devstack cinder-volume[86827]: INFO cinder.volume.driver [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Driver hasn't implemented _init_vendor_properties() Jul 21 08:08:12 devstack cinder-volume[86827]: DEBUG cinder.volume.driver [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7266807556152, 'free_capacity_gb': 1775.7266807556152, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86827) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_db.sqlalchemy.engines [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86827) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG dbcounter [-] [86827] Writer thread running {{(pid=86827) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.db.api [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Building query based on filter {{(pid=86827) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.image.image_utils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86827) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 08:08:13 devstack cinder-volume[86827]: INFO cinder.keymgr.migration [None req-191c60dc-8eeb-4ee4-b24a-298beb05dda7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=86827) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=86827) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:13 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:13 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:13 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.319s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Notifying Schedulers of capabilities ... {{(pid=86827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:08:13 devstack cinder-volume[86827]: INFO cinder.volume.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Driver initialization completed successfully. Jul 21 08:08:13 devstack cinder-volume[86827]: INFO cinder.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Initiating service 3 cleanup Jul 21 08:08:13 devstack cinder-volume[86827]: INFO cinder.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Service 3 cleanup completed. Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.service [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Creating RPC server for service cinder-volume {{(pid=86827) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.service [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86827) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 08:08:13 devstack cinder-volume[86827]: INFO cinder.volume.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=86827) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=86827) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:13 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:13 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:13 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:14 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:14 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.479s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:14 devstack cinder-volume[86827]: INFO cinder.volume.manager [None req-865c8afa-9293-45c9-b3ac-12548d96edfd None None] Driver post RPC initialization completed successfully. Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=86827) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG cinder.volume.drivers.quobyte [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=86827) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86827) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:17 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:17 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:17 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG oslo_concurrency.processutils [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.228s {{(pid=86827) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:17 devstack cinder-volume[86827]: DEBUG cinder.manager [None req-fd88bea8-15aa-40b5-9b48-fe22928a12f6 None None] Notifying Schedulers of capabilities ... {{(pid=86827) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:08:17 devstack cinder-volume[86612]: INFO oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Caught SIGTERM, stopping children Jul 21 08:08:17 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Acquiring lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:17 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Acquired lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:17 devstack cinder-volume[86612]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Releasing lock "singleton_lock" {{(pid=86612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:17 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Stop services. {{(pid=86612) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 21 08:08:17 devstack cinder-volume[86612]: DEBUG oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Killing children. {{(pid=86612) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 21 08:08:17 devstack cinder-volume[86612]: INFO oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Waiting on 1 children to exit Jul 21 08:08:18 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Acquiring lock "singleton_lock" {{(pid=86827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:18 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Acquired lock "singleton_lock" {{(pid=86827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:18 devstack cinder-volume[86827]: DEBUG oslo_concurrency.lockutils [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Releasing lock "singleton_lock" {{(pid=86827) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:18 devstack cinder-volume[86827]: WARNING amqp [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 08:08:18 devstack cinder-volume[86827]: WARNING amqp [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 21 08:08:18 devstack cinder-volume[86612]: INFO oslo_service.backend._eventlet.service [None req-e9e3f6b6-1d14-465a-ba5c-724209548be7 None None] Child 86827 exited with status 0 Jul 21 08:08:18 devstack cinder-volume[87103]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 21 08:08:18 devstack cinder-volume[87103]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 08:08:18 devstack cinder-volume[87103]: we strongly recommend against using it for new projects. Jul 21 08:08:18 devstack cinder-volume[87103]: If you are already using Eventlet, we recommend migrating to a different Jul 21 08:08:18 devstack cinder-volume[87103]: framework. For more detail see Jul 21 08:08:18 devstack cinder-volume[87103]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 08:08:18 devstack cinder-volume[87103]: import eventlet # noqa Jul 21 08:08:21 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 21 08:08:21 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 21 08:08:21 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 21 08:08:22 devstack cinder-volume[87103]: INFO dbcounter [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Registered counter for database cinder Jul 21 08:08:22 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:22 devstack cinder-volume[87103]: DEBUG dbcounter [-] [87103] Writer thread running {{(pid=87103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:08:22 devstack cinder-volume[87103]: INFO cinder.rpc [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 21 08:08:22 devstack cinder-volume[87103]: INFO cinder.rpc [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 21 08:08:22 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:23 devstack cinder-volume[87103]: INFO cinder.volume.manager [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Determined volume DB was empty at startup. Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG cinder.volume.manager [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87103) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 21 08:08:23 devstack cinder-volume[87103]: WARNING stevedore.named [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 21 08:08:23 devstack cinder-volume[87103]: WARNING castellan.key_manager [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:08:23 devstack cinder-volume[87103]: WARNING cinder.keymgr.conf_key_mgr [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 21 08:08:23 devstack cinder-volume[87103]: INFO cinder.volume.manager [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:23 devstack cinder-volume[87103]: INFO oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Starting 1 workers Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Started child 87372 {{(pid=87103) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Full set of CONF: {{(pid=87103) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] ******************************************************************************** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] Configuration options gathered from: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] ================================================================================ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] allow_availability_zone_fallback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] allow_compression_on_image_upload = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] allowed_direct_url_schemes = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] api_rate_limit = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87372]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] auth_strategy = keystone {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_stats_polling_interval = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backup_api_class = cinder.backup.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backup_name_template = backup-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backup_use_same_host = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backup_use_temp_snapshot = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] chap_username = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_internal_tenant_project_id = eae782d1e8f242efbfb5aed77460c50a {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_internal_tenant_user_id = 5e02d8b147ef4e6c838e320e15f30ce5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cluster = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] compression_format = gzip {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] compute_api_class = cinder.compute.nova.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] config_dir = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] config_source = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] control_exchange = openstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] debug = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] default_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] default_group_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] default_volume_type = QuobyteHD {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_ssl_cert_verify = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] driver_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] enable_new_services = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] enable_unsupported_driver = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] enabled_backends = ['QuobyteHD'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] enforce_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_api_insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_api_ssl_compression = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_ca_certificates_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_catalog_info = image:glance:publicURL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_num_retries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance_request_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] graceful_shutdown_timeout = 5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] group_api_class = cinder.group.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] host = devstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Starting volume driver QuobyteDriver (1.2) Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87372) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_compress_on_upload = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_conversion_address_space_limit = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_conversion_cpu_limit = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_conversion_disable = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_upload_use_cinder_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_upload_use_internal_tenant = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_volume_cache_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_volume_cache_max_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] image_volume_cache_max_size_gb = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] init_host_max_objects_retrieval = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] instance_format = [instance: %(uuid)s] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iscsi_target_flags = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iscsi_write_cache = on {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iser_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iser_ip_address = 192.168.122.140 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iser_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_color = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_config_append = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_options = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_rotate_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_rotate_interval_type = days {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] log_rotation_type = none {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] max_age = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] max_logfile_count = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] max_logfile_size_mb = 200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] max_over_subscription_ratio = 20.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] message_reap_interval = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] message_ttl = 2592000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] migration_create_volume_timeout_secs = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] monkey_patch = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] monkey_patch_modules = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] my_ip = 192.168.122.140 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] no_snapshot_gb_quota = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] num_iser_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] num_shell_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] num_volume_device_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] nvmeof_conn_info_version = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] nvmet_ns_id = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] nvmet_port_id = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_max_limit = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_ext_list = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_listen_port = 8776 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] osapi_volume_workers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] per_volume_size_limit = -1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] periodic_fuzzy_delay = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] periodic_interval = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] public_endpoint = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] publish_errors = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_backup_gigabytes = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_backups = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_gigabytes = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_groups = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_snapshots = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] quota_volumes = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] rate_limit_burst = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] rate_limit_except_level = CRITICAL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] rate_limit_interval = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] reinit_driver_count = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] report_discard_supported = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] report_interval = 120 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] reservation_clean_interval = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] reservation_expire = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] reserved_image_namespaces = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] reserved_percentage = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] rpc_response_timeout = 120 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] run_external_periodic_tasks = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] scst_target_driver = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_down_time = 720 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] shell_completion = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] snapshot_name_template = snapshot-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] state_path = /opt/stack/data/cinder {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] storage_availability_zone = nova {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] storage_protocol = iSCSI {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] syslog_log_facility = LOG_USER {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_helper = lioadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_ip_address = 192.168.122.140 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_protocol = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] target_secondary_ip_addresses = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87372) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 21 08:08:23 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 21 08:08:23 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Running cmd (subprocess): mount.quobyte {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] transport_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] until_refresh = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_chap_auth = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_default_quota_class = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_journal = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_json = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_stderr = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] use_syslog = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] verify_glance_signatures = enabled {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_api_class = cinder.volume.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_clear = zero {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_clear_size = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_copy_bps_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_dd_blocksize = 1M {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_name_template = volume-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_service_inithost_offload = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volume_usage_audit_period = month {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] zoning_mode = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_concurrency.disable_process_locking = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.auth_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.include_service_catalog = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.interface = public {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_password = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack quobyte-client[87381]: Reading configuration file: /etc/quobyte/client.cfg Jul 21 08:08:23 devstack quobyte-client[87381]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcache_username = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.service_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.backend = dogpile.cache.null {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.backend_argument = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.backend_expiration_time = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.config_prefix = cache.oslo {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.debug_cache_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.enable_retry_client = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.enable_socket_keepalive = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.expiration_time = 600 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.hashclient_retry_attempts = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_dead_retry = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_pool_maxsize = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_sasl_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.proxies = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.redis_db = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.redis_server = localhost:6379 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.retry_attempts = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.retry_delay = 0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.socket_keepalive_count = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.socket_keepalive_idle = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.socket_keepalive_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.socket_timeout = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.tls_allowed_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.tls_cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.tls_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.tls_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.tls_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cache.username = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] coordination.backend_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.asyncio_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.asyncio_slave_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.backend = sqlalchemy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.connection_debug = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.connection_parameters = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.connection_recycle_time = 3600 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.connection_trace = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.db_inc_retry_interval = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.db_max_retries = 20 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.db_max_retry_interval = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.db_retry_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.max_overflow = 50 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.max_pool_size = 5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.max_retries = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.mysql_wsrep_sync_wait = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.pool_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.retry_interval = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.slave_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.sqlite_synchronous = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.synchronous_reader = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] database.use_db_reconnect = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.connection_string = messaging:// {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.es_doc_type = notification {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.es_scroll_size = 10000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.es_scroll_time = 2m {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.filter_error_trace = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.hmac_keys = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.sentinel_service_name = mymaster {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.socket_timeout = 0.1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.trace_requests = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler.trace_sqlalchemy = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler_jaeger.process_tags = {} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler_jaeger.service_name_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] profiler_otlp.service_name_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.enforce_new_defaults = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.policy_default_rule = default {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.policy_file = policy.yaml {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:23 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.group = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.helper_command = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] privsep_osbrick.user = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.group = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.helper_command = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] cinder_sys_admin.user = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.send_service_user_token = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] service_user.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] glance.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.chap_username = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.driver_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.extra_capabilities = {} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iscsi_target_flags = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iscsi_write_cache = on {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iser_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iser_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_host = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_login = admin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_mount_options = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_private_key = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_share_path = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.num_shell_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.quobyte_volume_url = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.report_discard_supported = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.reserved_percentage = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_protocol = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.unique_fqdn_network = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.use_chap_auth = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_clear = zero {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_clear_size = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_reports.file_event_handler = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_reports.log_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.backend_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.chap_username = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.chiscsi_conf = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.driver_use_ssl = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.extra_capabilities = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iser_helper = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iser_ip_address = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iser_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.iser_target_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_login = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_mount_options = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_private_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_share_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_ssh_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.num_shell_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.nvmet_port_id = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.report_discard_supported = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.reserved_percentage = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.scst_target_driver = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.storage_protocol = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_helper = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_ip_address = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:23 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_protocol = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.use_chap_auth = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_clear = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_clear_size = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] QuobyteHD.volumes_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_notifications.driver = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_notifications.retry = -1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] key_manager.fixed_key = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.barbican_api_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.barbican_endpoint = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.barbican_endpoint_type = public {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.barbican_region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.number_of_retries = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.retry_delay = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.send_service_user_token = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.verify_ssl = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican.verify_ssl_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.auth_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] barbican_service_user.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.approle_role_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.approle_secret_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.auth_method = approle {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.auth_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.kv_mountpoint = secret {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.kv_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.kv_version = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.root_token_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.ssl_ca_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.token_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.token_role = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 21 08:08:24 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-44501bf9-2081-4b2f-9bee-b5fc786b4c36 None None] ******************************************************************************** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 21 08:08:24 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.590s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:24 devstack cinder-volume[87372]: INFO cinder.volume.driver [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Driver hasn't implemented _init_vendor_properties() Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG cinder.volume.driver [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7322578430176, 'free_capacity_gb': 1775.7322578430176, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87372) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_db.sqlalchemy.engines [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writer thread running {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG cinder.db.api [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Building query based on filter {{(pid=87372) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87372) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:24 devstack cinder-volume[87372]: INFO cinder.keymgr.migration [None req-7678351c-5960-40fe-a4eb-b7054e068710 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 21 08:08:24 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:24 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:25 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:08:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Driver initialization completed successfully. Jul 21 08:08:25 devstack cinder-volume[87372]: INFO cinder.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Initiating service 3 cleanup Jul 21 08:08:25 devstack cinder-volume[87372]: INFO cinder.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Service 3 cleanup completed. Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG cinder.service [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Creating RPC server for service cinder-volume {{(pid=87372) start /opt/stack/cinder/cinder/service.py:231}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG cinder.service [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87372) start /opt/stack/cinder/cinder/service.py:237}} Jul 21 08:08:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:08:25 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:08:25 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:08:25 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Jul 21 08:08:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.295s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:08:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dba549a2-9b1e-45a8-9080-8a94c4d44e13 None None] Driver post RPC initialization completed successfully. Jul 21 08:08:33 devstack cinder-volume[87103]: DEBUG dbcounter [-] [87103] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:08:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:08:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:08:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:08:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 6 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:08:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:09:38 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:09:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Flow 'volume_create_manager' (7898448e-61bc-4a33-b97d-cf132e558547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:09:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573ce2e2-dc30-493b-be65-1a36e3d4467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573ce2e2-dc30-493b-be65-1a36e3d4467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642174667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784f50cf-463f-4336-a587-f8c1da5ebd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a851118c16234d4ab0610ea05b66a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:09:39Z,use_quota=True,user_id='0ee4c655d8c74b98bf56f961dc692dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6e277-f8ed-4311-a4ac-58499f9e7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6e277-f8ed-4311-a4ac-58499f9e7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0f3d21-a330-4adc-8d62-7e9f586c7c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0f3d21-a330-4adc-8d62-7e9f586c7c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784f50cf-463f-4336-a587-f8c1da5ebd9c', 'volume_name': 'volume-784f50cf-463f-4336-a587-f8c1da5ebd9c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d262a5e-ffe5-41bc-9e52-0609e03f406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d262a5e-ffe5-41bc-9e52-0609e03f406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8b252-cb2f-4b4b-a0ed-15bdcb829476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Volume 784f50cf-463f-4336-a587-f8c1da5ebd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784f50cf-463f-4336-a587-f8c1da5ebd9c', 'volume_size': 1} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1642174667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784f50cf-463f-4336-a587-f8c1da5ebd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a851118c16234d4ab0610ea05b66a23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:09:39Z,use_quota=True,user_id='0ee4c655d8c74b98bf56f961dc692dc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Creating volume 784f50cf-463f-4336-a587-f8c1da5ebd9c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:09:39 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:09:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:39 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c 1073741824 Jul 21 08:09:39 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:40 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c 1073741824" returned: 0 in 0.890s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:40 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c Jul 21 08:09:40 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:40 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c" returned: 0 in 0.455s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8b252-cb2f-4b4b-a0ed-15bdcb829476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784f50cf-463f-4336-a587-f8c1da5ebd9c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0881e8-bafe-4d33-b5ce-521f466a5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Volume volume-784f50cf-463f-4336-a587-f8c1da5ebd9c (784f50cf-463f-4336-a587-f8c1da5ebd9c): created successfully Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0881e8-bafe-4d33-b5ce-521f466a5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Flow 'volume_create_manager' (7898448e-61bc-4a33-b97d-cf132e558547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:09:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-185330d7-67cc-42b6-b5f6-615474fc104b tempest-DeleteServersTestJSON-535403197 None] Created volume successfully. Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Flow 'volume_create_manager' (34a61de3-cfd4-4fa9-a302-ce496479b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba944c61-ed29-45c0-9058-a228b31403e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba944c61-ed29-45c0-9058-a228b31403e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1535591765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cbc4c3-211c-4b21-8a49-b0331c5158ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a487a9d2afbd4d96be4a4c4d6c56a289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:09:42Z,use_quota=True,user_id='6df3fa7d074242bc8916af60ff0f4219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464e3182-71b2-4b66-8892-f09c053d2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464e3182-71b2-4b66-8892-f09c053d2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00a75e9-da9c-42f6-abca-da9cb57114d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00a75e9-da9c-42f6-abca-da9cb57114d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cbc4c3-211c-4b21-8a49-b0331c5158ec', 'volume_name': 'volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32671ee5-350d-43bb-ae36-d6c73cc73bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32671ee5-350d-43bb-ae36-d6c73cc73bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0127b3d8-ed76-4db8-87f4-a04faa8f8e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:42 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Volume 52cbc4c3-211c-4b21-8a49-b0331c5158ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec', 'volume_size': 1} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1535591765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cbc4c3-211c-4b21-8a49-b0331c5158ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a487a9d2afbd4d96be4a4c4d6c56a289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:09:42Z,use_quota=True,user_id='6df3fa7d074242bc8916af60ff0f4219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Creating volume 52cbc4c3-211c-4b21-8a49-b0331c5158ec {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:09:42 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:09:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:42 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec 1073741824 Jul 21 08:09:42 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:43 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec 1073741824" returned: 0 in 0.956s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:43 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec Jul 21 08:09:43 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:44 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec" returned: 0 in 0.693s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0127b3d8-ed76-4db8-87f4-a04faa8f8e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537e070-7153-4b40-88f3-8ce2632ac750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:09:44 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Volume volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec (52cbc4c3-211c-4b21-8a49-b0331c5158ec): created successfully Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537e070-7153-4b40-88f3-8ce2632ac750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:09:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Flow 'volume_create_manager' (34a61de3-cfd4-4fa9-a302-ce496479b056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:09:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-667841a4-e466-48ec-9f9a-1f309452d026 tempest-VolumesAdminNegativeTest-58271887 None] Created volume successfully. Jul 21 08:09:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Acquiring lock "cinder-52cbc4c3-211c-4b21-8a49-b0331c5158ec-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:09:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "cinder-52cbc4c3-211c-4b21-8a49-b0331c5158ec-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:09:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Acquiring lock "cinder-quobyte-52cbc4c3-211c-4b21-8a49-b0331c5158ec" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:09:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "cinder-quobyte-52cbc4c3-211c-4b21-8a49-b0331c5158ec" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:09:46 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4hg8yzs5/privsep.sock'] Jul 21 08:09:46 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4hg8yzs5/privsep.sock Jul 21 08:09:46 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING py.warnings [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 21 08:09:47 devstack cinder-volume[87372]: .first() Jul 21 08:09:47 devstack cinder-volume[87372]: Jul 21 08:09:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: Jul 21 08:09:47 devstack cinder-volume[87372]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 21 08:09:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-784f50cf-463f-4336-a587-f8c1da5ebd9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bf8d8a8-b726-463e-b9d0-e8613b542fb3', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:09:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-b2610a6e-d4f0-4722-97f7-7cdc3199a210 req-4ec7e951-ea95-47e4-8cac-dc529e33b664 tempest-DeleteServersTestJSON-535403197 None] attachment_update completed successfully. Jul 21 08:09:48 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:48 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Spawned new privsep daemon via rootwrap Jul 21 08:09:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Accepted privsep connection to /tmp/tmp4hg8yzs5/privsep.sock {{(pid=87372) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 21 08:09:48 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 21 08:09:48 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 21 08:09:48 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 21 08:09:48 devstack cinder-volume[87372]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88536 Jul 21 08:09:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd1701-b55e-419f-a466-fc76f0e41603]: (2,) {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:09:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f90ac6d-38cb-4a7a-8aad-51dc52f6cc08]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:09:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:48 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec Jul 21 08:09:48 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:49 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec" returned: 0 in 0.948s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:49 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec Jul 21 08:09:49 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:49 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-52cbc4c3-211c-4b21-8a49-b0331c5158ec" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "cinder-quobyte-52cbc4c3-211c-4b21-8a49-b0331c5158ec" released by "delete_volume" :: held 3.724s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:09:49 devstack cinder-volume[87372]: WARNING cinder.quota [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:09:49 devstack cinder-volume[87372]: WARNING cinder.quota [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Created reservations ['c90b8462-e5b4-4d5c-8df3-13f51339775b', 'dfc428f0-9d25-4cff-8324-9cd7c9a39567', 'fb9f0f2a-159b-4f9d-8ad1-24e2a92a5285', 'a7f4e37e-56d5-46d5-8720-41adbca921d4'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:50 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:09:50 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:50 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.663s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:09:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Deleted volume successfully. Jul 21 08:09:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4bf0ee30-deb1-4639-aa86-54d32d4ada3c tempest-VolumesAdminNegativeTest-58271887 None] Lock "cinder-52cbc4c3-211c-4b21-8a49-b0331c5158ec-delete_volume" released by "delete_volume" :: held 4.953s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:52 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:09:52 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:52 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:09:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:09:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 8 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:09:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:09:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-0f354b46-2f2b-4eba-b4ef-9db318279069 req-ce7b1457-b381-4ce6-95d4-8510ff167b85 tempest-DeleteServersTestJSON-535403197 None] Terminate volume connection completed successfully. Jul 21 08:09:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-0f354b46-2f2b-4eba-b4ef-9db318279069 req-ce7b1457-b381-4ce6-95d4-8510ff167b85 tempest-DeleteServersTestJSON-535403197 None] Deleting attachment 8bf8d8a8-b726-463e-b9d0-e8613b542fb3. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "cinder-784f50cf-463f-4336-a587-f8c1da5ebd9c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "cinder-784f50cf-463f-4336-a587-f8c1da5ebd9c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "cinder-quobyte-784f50cf-463f-4336-a587-f8c1da5ebd9c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "cinder-quobyte-784f50cf-463f-4336-a587-f8c1da5ebd9c" acquired by "delete_volume" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a8b0e-3919-4f73-8fd7-03b8f2f57050]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:09:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:55 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c Jul 21 08:09:55 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:56 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c" returned: 0 in 0.409s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:56 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c Jul 21 08:09:56 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:56 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-784f50cf-463f-4336-a587-f8c1da5ebd9c" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "cinder-quobyte-784f50cf-463f-4336-a587-f8c1da5ebd9c" released by "delete_volume" :: held 0.728s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Created reservations ['e351dcb5-80b4-4e7d-9881-f14849859a09', 'ba9b3848-bfe2-43a9-8056-c727565b4b80', 'fad25485-b0d8-4016-a10b-3544d412fd4f', 'd909e28f-8a30-4965-9ea3-836ed6bd7e54'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:09:56 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:09:56 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:09:56 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Jul 21 08:09:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.370s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:09:57 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:09:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Deleted volume successfully. Jul 21 08:09:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67abb6aa-2001-4f91-8b98-e9563d9d8e71 tempest-DeleteServersTestJSON-535403197 None] Lock "cinder-784f50cf-463f-4336-a587-f8c1da5ebd9c-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:06 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (04b08d47-db35-406c-a569-95444d371f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990eb446-f3e7-443d-8e5b-b792d27b1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990eb446-f3e7-443d-8e5b-b792d27b1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-116723658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30dbf52-e3da-40bf-b6a4-5b18f720f825,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:08Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e53e9ed-4141-4fcc-954d-67eadeacb83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e53e9ed-4141-4fcc-954d-67eadeacb83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aaac08-24b7-41cc-88b3-9634dcfc475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aaac08-24b7-41cc-88b3-9634dcfc475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30dbf52-e3da-40bf-b6a4-5b18f720f825', 'volume_name': 'volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50b1013-6183-47da-bc5e-c5fcfecf4d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50b1013-6183-47da-bc5e-c5fcfecf4d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3037ba97-5af5-4032-acc8-350188b69abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Volume f30dbf52-e3da-40bf-b6a4-5b18f720f825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825', 'volume_size': 1} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-116723658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30dbf52-e3da-40bf-b6a4-5b18f720f825,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:08Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Creating volume f30dbf52-e3da-40bf-b6a4-5b18f720f825 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:07 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:07 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 1073741824 Jul 21 08:10:07 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:08 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 1073741824" returned: 0 in 0.515s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:08 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 Jul 21 08:10:08 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:08 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3037ba97-5af5-4032-acc8-350188b69abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f3a48f-3579-4829-937f-131f00a90965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Volume volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 (f30dbf52-e3da-40bf-b6a4-5b18f720f825): created successfully Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f3a48f-3579-4829-937f-131f00a90965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (04b08d47-db35-406c-a569-95444d371f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e901dbed-5f12-425f-aad5-5982f9178261 tempest-VolumesTestJSON-262777533 None] Created volume successfully. Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (029c38d0-2b76-4c04-9b71-27a6a7b12da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52525fc-990c-4c92-8ff6-cc027038a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52525fc-990c-4c92-8ff6-cc027038a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-569118239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c356976-114c-477e-8a7e-4186ec8f1d02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:10Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebaf2a6-0fe5-4b86-87ba-5dd6561ddc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebaf2a6-0fe5-4b86-87ba-5dd6561ddc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38a20c2-5f4f-4ef5-85ad-07658ac4628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38a20c2-5f4f-4ef5-85ad-07658ac4628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c356976-114c-477e-8a7e-4186ec8f1d02', 'volume_name': 'volume-4c356976-114c-477e-8a7e-4186ec8f1d02', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86542ee6-8f4e-4dba-88b2-de73bb036161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86542ee6-8f4e-4dba-88b2-de73bb036161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c3c4e-0094-4461-bd9e-da7266c22360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Volume 4c356976-114c-477e-8a7e-4186ec8f1d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c356976-114c-477e-8a7e-4186ec8f1d02', 'volume_size': 1} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-569118239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c356976-114c-477e-8a7e-4186ec8f1d02,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:10Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Creating volume 4c356976-114c-477e-8a7e-4186ec8f1d02 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:10 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 1073741824 Jul 21 08:10:10 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:11 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 1073741824" returned: 0 in 0.523s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:11 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 Jul 21 08:10:11 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:11 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02" returned: 0 in 0.281s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671c3c4e-0094-4461-bd9e-da7266c22360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c356976-114c-477e-8a7e-4186ec8f1d02', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb0a4bf-8b7a-4060-af31-f9b7622f06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Volume volume-4c356976-114c-477e-8a7e-4186ec8f1d02 (4c356976-114c-477e-8a7e-4186ec8f1d02): created successfully Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb0a4bf-8b7a-4060-af31-f9b7622f06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (029c38d0-2b76-4c04-9b71-27a6a7b12da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3a1087c1-8248-4ebd-834e-243bf568406a tempest-VolumesTestJSON-262777533 None] Created volume successfully. Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (24faebe5-aad8-44f8-b88d-c1391a5bff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb21194-f792-4482-a289-2e860defb2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb21194-f792-4482-a289-2e860defb2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279839978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df2245-d4e9-4822-803e-098982260500,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:13Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9eeb02-e0e2-4d2c-bd73-b8a52c633159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9eeb02-e0e2-4d2c-bd73-b8a52c633159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb16a597-1980-4799-b323-59d0e7fc1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb16a597-1980-4799-b323-59d0e7fc1679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6df2245-d4e9-4822-803e-098982260500', 'volume_name': 'volume-f6df2245-d4e9-4822-803e-098982260500', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353c7726-5cdd-47e8-b3c9-107d63a9279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353c7726-5cdd-47e8-b3c9-107d63a9279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c4f24-06ba-4001-bc8c-9d994cc3d559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Volume f6df2245-d4e9-4822-803e-098982260500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6df2245-d4e9-4822-803e-098982260500', 'volume_size': 1} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1279839978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6df2245-d4e9-4822-803e-098982260500,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f4199b781a541488b2780b51cde77ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:13Z,use_quota=True,user_id='7b632f1b7d144ae5abc15ec6099a9d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Creating volume f6df2245-d4e9-4822-803e-098982260500 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:13 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 1073741824 Jul 21 08:10:13 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:13 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 1073741824" returned: 0 in 0.498s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:14 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 Jul 21 08:10:14 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:14 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c4f24-06ba-4001-bc8c-9d994cc3d559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6df2245-d4e9-4822-803e-098982260500', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e77efc-08b4-4458-b634-d4e7938412b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Volume volume-f6df2245-d4e9-4822-803e-098982260500 (f6df2245-d4e9-4822-803e-098982260500): created successfully Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e77efc-08b4-4458-b634-d4e7938412b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Flow 'volume_create_manager' (24faebe5-aad8-44f8-b88d-c1391a5bff62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-28e5cebb-1bdb-4627-80da-a624533d6771 tempest-VolumesTestJSON-262777533 None] Created volume successfully. Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-f6df2245-d4e9-4822-803e-098982260500-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "cinder-f6df2245-d4e9-4822-803e-098982260500-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-quobyte-f6df2245-d4e9-4822-803e-098982260500" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-f6df2245-d4e9-4822-803e-098982260500" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ffd29a-70e0-49f6-93ed-a4316a736473]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:17 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 Jul 21 08:10:17 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:17 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500" returned: 0 in 0.656s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:17 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500 Jul 21 08:10:17 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Flow 'volume_create_manager' (ec49f13d-c8a0-4ce1-8de8-a280d68e4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d204d5b-65a7-4ce2-91e2-8b0b5c57ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d204d5b-65a7-4ce2-91e2-8b0b5c57ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-584085089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212bc318-aad9-4dd7-bec5-cd29e04aad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1651e983180f4603a0268a05015d5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:18Z,use_quota=True,user_id='0168bedead114edd8d05e88932fa9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb8004-f0b8-40b0-9282-61d68a0dbe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cb8004-f0b8-40b0-9282-61d68a0dbe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bb9100-2e7f-4346-a8f3-f9f0c5b8239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bb9100-2e7f-4346-a8f3-f9f0c5b8239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'volume_name': 'volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aad1699-46bb-4614-b25d-f8941e06c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aad1699-46bb-4614-b25d-f8941e06c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8cd0b7-f866-4348-8d4d-74a1da7e8747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:18 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Volume 212bc318-aad9-4dd7-bec5-cd29e04aad4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'volume_size': 1} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-584085089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212bc318-aad9-4dd7-bec5-cd29e04aad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1651e983180f4603a0268a05015d5e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:18Z,use_quota=True,user_id='0168bedead114edd8d05e88932fa9c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Creating volume 212bc318-aad9-4dd7-bec5-cd29e04aad4e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:18 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e 1073741824 Jul 21 08:10:18 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:18 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f6df2245-d4e9-4822-803e-098982260500" returned: 0 in 0.600s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-f6df2245-d4e9-4822-803e-098982260500" released by "delete_volume" :: held 1.327s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Created reservations ['d24be2c3-9cac-4cb7-b63d-58c42446fe1a', '41c527bf-6dfa-48df-92d4-1676c8245642', '152bd601-92ef-4b65-a95c-a8d9e7d00188', 'b6f2af8e-e5f1-4b5d-a889-0344ea76906f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:18 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:18 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:18 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e 1073741824" returned: 0 in 0.734s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:19 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.307s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:19 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:19 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Deleted volume successfully. Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90d20912-17ef-419e-b08b-289f20a639e0 tempest-VolumesTestJSON-262777533 None] Lock "cinder-f6df2245-d4e9-4822-803e-098982260500-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:19 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e" returned: 0 in 0.343s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8cd0b7-f866-4348-8d4d-74a1da7e8747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffbb12-e591-48b9-98de-0072382309f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Volume volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e (212bc318-aad9-4dd7-bec5-cd29e04aad4e): created successfully Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffbb12-e591-48b9-98de-0072382309f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Flow 'volume_create_manager' (ec49f13d-c8a0-4ce1-8de8-a280d68e4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3c87c2ba-5fd3-4fe1-8e1b-9082c22823aa tempest-ServerActionsTestOtherA-2076468163 None] Created volume successfully. Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-4c356976-114c-477e-8a7e-4186ec8f1d02-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "cinder-4c356976-114c-477e-8a7e-4186ec8f1d02-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-quobyte-4c356976-114c-477e-8a7e-4186ec8f1d02" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-4c356976-114c-477e-8a7e-4186ec8f1d02" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cea76b6-9d16-457a-8a6a-2ec1e48be6ab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:19 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 Jul 21 08:10:19 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:19 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:19 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02 Jul 21 08:10:19 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:20 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c356976-114c-477e-8a7e-4186ec8f1d02" returned: 0 in 0.280s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-4c356976-114c-477e-8a7e-4186ec8f1d02" released by "delete_volume" :: held 0.744s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Created reservations ['c299a36c-46c9-4e35-9efd-427cd23a4f01', '5c954407-ff80-43b7-935a-33cccec83bc8', '0a942a2b-27ee-4e37-a13b-bc0852a56427', '4fbb12cd-cc76-4cd7-ab5f-3945f142b1cc'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:20 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:20 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:20 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Deleted volume successfully. Jul 21 08:10:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-997b1218-60f9-48ce-9e4c-d0e4e35ef416 tempest-VolumesTestJSON-262777533 None] Lock "cinder-4c356976-114c-477e-8a7e-4186ec8f1d02-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-f30dbf52-e3da-40bf-b6a4-5b18f720f825-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "cinder-f30dbf52-e3da-40bf-b6a4-5b18f720f825-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Acquiring lock "cinder-quobyte-f30dbf52-e3da-40bf-b6a4-5b18f720f825" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-f30dbf52-e3da-40bf-b6a4-5b18f720f825" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6029a9fb-0112-42f5-8abd-a7826d709e27]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:21 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 Jul 21 08:10:21 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:21 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825" returned: 0 in 0.389s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:21 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825 Jul 21 08:10:21 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:21 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f30dbf52-e3da-40bf-b6a4-5b18f720f825" returned: 0 in 0.330s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "cinder-quobyte-f30dbf52-e3da-40bf-b6a4-5b18f720f825" released by "delete_volume" :: held 0.803s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Created reservations ['b1c5ec3c-6bf1-4492-9f6e-1e103ee04d3d', '0bc6d7e0-3ae4-4f31-a9de-7b66742e904f', '20e603a4-dc9b-4ae0-a995-95be5c2c3ed5', 'ec4f6bfa-09f3-4ef3-a863-95d568dd36be'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:22 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:22 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:22 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.492s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Deleted volume successfully. Jul 21 08:10:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7c21cb40-93cf-4273-a59b-189b9c7a02e8 tempest-VolumesTestJSON-262777533 None] Lock "cinder-f30dbf52-e3da-40bf-b6a4-5b18f720f825-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fd64882d-c39c-4f7b-b8ee-3238e4a691fd tempest-BackendsCapabilitiesAdminTestsJSON-1497946333 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7322578430176, 'free_capacity_gb': 1775.7322578430176, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87372) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 08:10:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f2cad069-591f-4cf5-9677-d3ab8f968096 tempest-BackendsCapabilitiesAdminTestsJSON-1497946333 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7322578430176, 'free_capacity_gb': 1775.7322578430176, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87372) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 08:10:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:10:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=18,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=5 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:10:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b9cf6660-0379-43fb-aac5-bb6aeb284244 tempest-GroupsTest-351403737 None] Group tempest-Group1-1509076297: creating Jul 21 08:10:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b9cf6660-0379-43fb-aac5-bb6aeb284244 tempest-GroupsTest-351403737 None] Group tempest-Group1-1509076297: created successfully Jul 21 08:10:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b9cf6660-0379-43fb-aac5-bb6aeb284244 tempest-GroupsTest-351403737 None] Create group completed successfully. Jul 21 08:10:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01906efb-5346-4f1e-b0ef-f3446da563ca tempest-GroupsTest-351403737 None] Group tempest-Group2-1969048270: creating Jul 21 08:10:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01906efb-5346-4f1e-b0ef-f3446da563ca tempest-GroupsTest-351403737 None] Group tempest-Group2-1969048270: created successfully Jul 21 08:10:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01906efb-5346-4f1e-b0ef-f3446da563ca tempest-GroupsTest-351403737 None] Create group completed successfully. Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (4c85b38f-104e-4d47-96e5-c0323e89f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79453d28-02ca-46ac-b75a-80c861d8603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79453d28-02ca-46ac-b75a-80c861d8603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2074473514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66d10f05-3e74-4f81-86f9-a13f8b4718bf,host='devstack@QuobyteHD#QuobyteHD',id=70381c4d-efd8-455c-9aec-93c403554c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:49Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d715278f-f1d2-4519-b89b-7a71482fa732),volume_type_id=d715278f-f1d2-4519-b89b-7a71482fa732)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077f5c63-c711-4ff2-a8b6-e8c139d1d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077f5c63-c711-4ff2-a8b6-e8c139d1d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3670c67c-fd86-4c8d-9306-916acfdd795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3670c67c-fd86-4c8d-9306-916acfdd795e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70381c4d-efd8-455c-9aec-93c403554c26', 'volume_name': 'volume-70381c4d-efd8-455c-9aec-93c403554c26', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89434b-429f-463b-bc34-25cd82ea1402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89434b-429f-463b-bc34-25cd82ea1402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f07f889-3205-4dd4-9256-202e988e943b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Volume 70381c4d-efd8-455c-9aec-93c403554c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70381c4d-efd8-455c-9aec-93c403554c26', 'volume_size': 1} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66d10f05-3e74-4f81-86f9-a13f8b4718bf,created_at=2026-07-21T06:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2074473514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66d10f05-3e74-4f81-86f9-a13f8b4718bf,host='devstack@QuobyteHD#QuobyteHD',id=70381c4d-efd8-455c-9aec-93c403554c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:49Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d715278f-f1d2-4519-b89b-7a71482fa732),volume_type_id=d715278f-f1d2-4519-b89b-7a71482fa732)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Creating volume 70381c4d-efd8-455c-9aec-93c403554c26 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:49 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:49 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 1073741824 Jul 21 08:10:49 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:50 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 1073741824" returned: 0 in 0.961s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:50 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 Jul 21 08:10:50 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:51 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26" returned: 0 in 0.367s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f07f889-3205-4dd4-9256-202e988e943b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70381c4d-efd8-455c-9aec-93c403554c26', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f3d404-ad47-4fd3-b726-b3d4933de009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:51 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Volume volume-70381c4d-efd8-455c-9aec-93c403554c26 (70381c4d-efd8-455c-9aec-93c403554c26): created successfully Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f3d404-ad47-4fd3-b726-b3d4933de009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (4c85b38f-104e-4d47-96e5-c0323e89f520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:51 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ce3999da-e2ea-4386-8920-5753b44bf4c3 tempest-GroupsTest-351403737 None] Created volume successfully. Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:52 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:52 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:53 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.482s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 8 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:10:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Acquiring lock "cinder-quobyte-70381c4d-efd8-455c-9aec-93c403554c26" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-70381c4d-efd8-455c-9aec-93c403554c26" acquired by "delete_volume" :: waited 0.059s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fda5d4-4ba5-457d-ad1a-07a1083797cf]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:54 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 Jul 21 08:10:54 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:54 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Flow 'volume_create_manager' (5cd6c355-7158-4383-ab0a-2cb86115dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64790f61-9098-4c25-aa38-bb181211898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26" returned: 0 in 0.783s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64790f61-9098-4c25-aa38-bb181211898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1946817889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa1c6ff-9d04-4c42-8942-e6a0262ba290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd767900d714ec5b803ff49a550be2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:55Z,use_quota=True,user_id='82cea53eea504a64a03579bcf0af413d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2c3649-cd40-478f-97e1-63ae8b1f0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2c3649-cd40-478f-97e1-63ae8b1f0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:55 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26 Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc232503-6285-4050-b693-eb70206273f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:55 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc232503-6285-4050-b693-eb70206273f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa1c6ff-9d04-4c42-8942-e6a0262ba290', 'volume_name': 'volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298f4f5f-a3e5-4c70-a444-3fa2b0f943f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298f4f5f-a3e5-4c70-a444-3fa2b0f943f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f54f29f-75a8-4f1b-a172-7f5a912674fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:55 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Volume 8fa1c6ff-9d04-4c42-8942-e6a0262ba290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290', 'volume_size': 1} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1946817889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa1c6ff-9d04-4c42-8942-e6a0262ba290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd767900d714ec5b803ff49a550be2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:55Z,use_quota=True,user_id='82cea53eea504a64a03579bcf0af413d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Creating volume 8fa1c6ff-9d04-4c42-8942-e6a0262ba290 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:55 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:55 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 1073741824 Jul 21 08:10:55 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:55 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70381c4d-efd8-455c-9aec-93c403554c26" returned: 0 in 0.566s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-70381c4d-efd8-455c-9aec-93c403554c26" released by "delete_volume" :: held 1.527s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:10:55 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Created reservations ['cf359200-b1e5-4d05-9af9-2cc68b542109'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Flow 'volume_create_manager' (a6705108-b3f8-4e34-bb56-b9a6acb00bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610870f3-3a3e-4eec-a729-ac7d3b784945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610870f3-3a3e-4eec-a729-ac7d3b784945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-456975804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a987da47-b6df-44e3-a545-ffa83e675cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a2f29ff664f19b66b81c7a83c394e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:56Z,use_quota=True,user_id='7311294a7e2546a49b699c3eb75d9cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463355aa-8658-4352-843a-6f06dedceced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463355aa-8658-4352-843a-6f06dedceced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ec8b25-4f51-4bd8-8b8d-5d43c20ef063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ec8b25-4f51-4bd8-8b8d-5d43c20ef063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a987da47-b6df-44e3-a545-ffa83e675cc6', 'volume_name': 'volume-a987da47-b6df-44e3-a545-ffa83e675cc6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c2a4bf-6d23-4023-9271-8a81f569b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c2a4bf-6d23-4023-9271-8a81f569b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e559bfaa-f4f7-40d5-9ab4-be07936f53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Volume a987da47-b6df-44e3-a545-ffa83e675cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a987da47-b6df-44e3-a545-ffa83e675cc6', 'volume_size': 1} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 1073741824" returned: 0 in 1.136s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:56 devstack cinder-volume[87372]: WARNING cinder.quota [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-579997341 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-579997341, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:10:56 devstack cinder-volume[87372]: WARNING cinder.quota [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-579997341 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-579997341, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Created reservations ['864313e4-397d-49ff-ba67-5433825d5d46', '6daca6e7-ce0b-4333-b682-d77a3407ebfd', '10c63ca6-710d-4886-9d0a-95e8dd6afa7f', '47a3154b-2343-42db-b98f-33c0495015b3'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:56 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 Jul 21 08:10:56 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:56 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:56 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:56 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" returned: 0 in 0.361s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.463s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-456975804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a987da47-b6df-44e3-a545-ffa83e675cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9a2f29ff664f19b66b81c7a83c394e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:10:56Z,use_quota=True,user_id='7311294a7e2546a49b699c3eb75d9cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Creating volume a987da47-b6df-44e3-a545-ffa83e675cc6 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:10:56 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f54f29f-75a8-4f1b-a172-7f5a912674fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585dfb9-5014-4348-a715-d1921bcc1dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:56 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 1073741824 Jul 21 08:10:56 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Volume volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 (8fa1c6ff-9d04-4c42-8942-e6a0262ba290): created successfully Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d585dfb9-5014-4348-a715-d1921bcc1dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Flow 'volume_create_manager' (5cd6c355-7158-4383-ab0a-2cb86115dd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-be06a4c0-c447-49a4-a088-e7cf16839fab tempest-TaggedAttachmentsTest-1508866370 None] Created volume successfully. Jul 21 08:10:56 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:56 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-81257b5e-da18-44d1-86af-b0b4669e27d4 tempest-GroupsTest-351403737 None] Delete group completed successfully. Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Created reservations ['a07f3b09-97a3-4e0c-8bf4-165d1e4e4856'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:57 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:10:57 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:57 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 1073741824" returned: 0 in 0.643s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:10:57 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 Jul 21 08:10:57 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:10:57 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.308s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:10:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3c0a0a5e-14dd-46d1-b47f-3f81506c548d tempest-GroupsTest-351403737 None] Delete group completed successfully. Jul 21 08:10:57 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6" returned: 0 in 0.279s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e559bfaa-f4f7-40d5-9ab4-be07936f53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a987da47-b6df-44e3-a545-ffa83e675cc6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07443cb2-6a51-4a84-8387-55a22e8bae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:10:57 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Volume volume-a987da47-b6df-44e3-a545-ffa83e675cc6 (a987da47-b6df-44e3-a545-ffa83e675cc6): created successfully Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07443cb2-6a51-4a84-8387-55a22e8bae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:10:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Flow 'volume_create_manager' (a6705108-b3f8-4e34-bb56-b9a6acb00bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:10:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0dc8070d-0a3c-46a8-b01b-25fd665ee26c tempest-ServerRescueNegativeTestJSON-1966033898 None] Created volume successfully. Jul 21 08:10:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-da7ebcbe-6566-4360-a43f-782e21950e45 tempest-GroupsTest-351403737 None] Group tempest-GroupsTest-Group-388258467: creating Jul 21 08:10:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-da7ebcbe-6566-4360-a43f-782e21950e45 tempest-GroupsTest-351403737 None] Group tempest-GroupsTest-Group-388258467: created successfully Jul 21 08:10:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-da7ebcbe-6566-4360-a43f-782e21950e45 tempest-GroupsTest-351403737 None] Create group completed successfully. Jul 21 08:11:00 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (c17ef02f-7e94-4b61-a1bc-14f365d1a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fdf64-3c5d-4414-a6d0-a12cd808d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0fdf64-3c5d-4414-a6d0-a12cd808d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-61976820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,host='devstack@QuobyteHD#QuobyteHD',id=08212d47-9aeb-44a5-b825-a4bce316238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:01Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a4e6e1-2444-4ea8-86e7-123fa633050c),volume_type_id=59a4e6e1-2444-4ea8-86e7-123fa633050c)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39903928-68b2-4877-ab9e-0f2887883d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39903928-68b2-4877-ab9e-0f2887883d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d844dbe-51ee-42db-aa71-e492f35eee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d844dbe-51ee-42db-aa71-e492f35eee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08212d47-9aeb-44a5-b825-a4bce316238c', 'volume_name': 'volume-08212d47-9aeb-44a5-b825-a4bce316238c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4989b55e-2891-4a0a-84bf-1aa8528fb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4989b55e-2891-4a0a-84bf-1aa8528fb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4298efed-70cc-49ae-9ad3-a12b4ba321a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:01 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Volume 08212d47-9aeb-44a5-b825-a4bce316238c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08212d47-9aeb-44a5-b825-a4bce316238c', 'volume_size': 1} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,created_at=2026-07-21T06:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-61976820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,host='devstack@QuobyteHD#QuobyteHD',id=08212d47-9aeb-44a5-b825-a4bce316238c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:01Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a4e6e1-2444-4ea8-86e7-123fa633050c),volume_type_id=59a4e6e1-2444-4ea8-86e7-123fa633050c)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Creating volume 08212d47-9aeb-44a5-b825-a4bce316238c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:11:01 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:01 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c 1073741824 Jul 21 08:11:01 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:01 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c 1073741824" returned: 0 in 0.671s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:01 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c Jul 21 08:11:01 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:02 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c" returned: 0 in 0.446s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4298efed-70cc-49ae-9ad3-a12b4ba321a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08212d47-9aeb-44a5-b825-a4bce316238c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e44c9f-19b2-45ca-82e7-5143399e5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:02 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Volume volume-08212d47-9aeb-44a5-b825-a4bce316238c (08212d47-9aeb-44a5-b825-a4bce316238c): created successfully Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e44c9f-19b2-45ca-82e7-5143399e5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (c17ef02f-7e94-4b61-a1bc-14f365d1a59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-12efab65-f79b-4053-b732-a6000e8474c2 tempest-GroupsTest-351403737 None] Created volume successfully. Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (70837849-51d5-418a-84c3-f57ee302c93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588a88bd-088c-4f2c-aabf-954e4f520a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588a88bd-088c-4f2c-aabf-954e4f520a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1092488230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,host='devstack@QuobyteHD#QuobyteHD',id=234be2e9-ec93-4178-bce0-3b973738dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:04Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a4e6e1-2444-4ea8-86e7-123fa633050c),volume_type_id=59a4e6e1-2444-4ea8-86e7-123fa633050c)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c18995-8c60-49cf-8118-0e1ecca3a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c18995-8c60-49cf-8118-0e1ecca3a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96800cbf-164f-47cf-a239-6abde6c62781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96800cbf-164f-47cf-a239-6abde6c62781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234be2e9-ec93-4178-bce0-3b973738dc79', 'volume_name': 'volume-234be2e9-ec93-4178-bce0-3b973738dc79', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d88aa-4090-4182-90be-f764f588e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d88aa-4090-4182-90be-f764f588e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235a67ab-87c6-4624-9a09-34f2067276f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:04 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Volume 234be2e9-ec93-4178-bce0-3b973738dc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234be2e9-ec93-4178-bce0-3b973738dc79', 'volume_size': 1} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,created_at=2026-07-21T06:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1092488230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50dfafd6-e4ce-452f-b34d-ed227ac7aed6,host='devstack@QuobyteHD#QuobyteHD',id=234be2e9-ec93-4178-bce0-3b973738dc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27c6f31e63477da8d0eb276f4fdf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:04Z,use_quota=True,user_id='3d056812d7f54018884aea891028c86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59a4e6e1-2444-4ea8-86e7-123fa633050c),volume_type_id=59a4e6e1-2444-4ea8-86e7-123fa633050c)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Creating volume 234be2e9-ec93-4178-bce0-3b973738dc79 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:11:04 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:11:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:04 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 1073741824 Jul 21 08:11:04 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:05 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 1073741824" returned: 0 in 1.031s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:05 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 Jul 21 08:11:05 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:06 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79" returned: 0 in 0.494s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235a67ab-87c6-4624-9a09-34f2067276f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234be2e9-ec93-4178-bce0-3b973738dc79', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae82eb2-362f-4de2-b92d-2001563daa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Volume volume-234be2e9-ec93-4178-bce0-3b973738dc79 (234be2e9-ec93-4178-bce0-3b973738dc79): created successfully Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae82eb2-362f-4de2-b92d-2001563daa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Flow 'volume_create_manager' (70837849-51d5-418a-84c3-f57ee302c93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:06 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7c6c6ada-4611-474d-ae3b-a6b55624afe2 tempest-GroupsTest-351403737 None] Created volume successfully. Jul 21 08:11:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a2125679-2c86-4abb-9848-3dcaff4f1983 tempest-GroupsTest-351403737 None] Update group completed successfully. Jul 21 08:11:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2ada2797-47d6-4dc0-80f8-5954c1f13a31 tempest-GroupsTest-351403737 None] Update group completed successfully. Jul 21 08:11:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Acquiring lock "cinder-a987da47-b6df-44e3-a545-ffa83e675cc6-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "cinder-a987da47-b6df-44e3-a545-ffa83e675cc6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Acquiring lock "cinder-quobyte-a987da47-b6df-44e3-a545-ffa83e675cc6" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "cinder-quobyte-a987da47-b6df-44e3-a545-ffa83e675cc6" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c175bd-4522-492e-9916-577c7711ce41]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:10 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 Jul 21 08:11:10 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:10 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6" returned: 0 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:10 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6 Jul 21 08:11:10 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:10 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a987da47-b6df-44e3-a545-ffa83e675cc6" returned: 0 in 0.337s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "cinder-quobyte-a987da47-b6df-44e3-a545-ffa83e675cc6" released by "delete_volume" :: held 0.916s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Created reservations ['a4b039c3-beaf-43ea-bf3b-322e5799a964', '5b2422f2-180d-4df1-b8ce-abf52922abc0', 'a3de8f6f-711b-405e-b804-2cbcd2080b3f', '808fa494-b7e2-4bee-aa33-47452848fbc9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:11 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:11 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:12 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.825s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:11:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Deleted volume successfully. Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f7f1b407-e3e1-447f-9543-87ef712dbe6f tempest-ServerRescueNegativeTestJSON-1966033898 None] Lock "cinder-a987da47-b6df-44e3-a545-ffa83e675cc6-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Acquiring lock "cinder-quobyte-08212d47-9aeb-44a5-b825-a4bce316238c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-08212d47-9aeb-44a5-b825-a4bce316238c" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bffff-6516-4a42-b4f5-e5c100a35dd1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:11:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:12 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c Jul 21 08:11:12 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:13 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c" returned: 0 in 0.968s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:13 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c Jul 21 08:11:13 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:14 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08212d47-9aeb-44a5-b825-a4bce316238c" returned: 0 in 0.665s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-08212d47-9aeb-44a5-b825-a4bce316238c" released by "delete_volume" :: held 1.731s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Acquiring lock "cinder-quobyte-234be2e9-ec93-4178-bce0-3b973738dc79" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-234be2e9-ec93-4178-bce0-3b973738dc79" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf518722-d16a-429d-9b72-de8c0e265ce1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:11:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:14 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 Jul 21 08:11:14 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:15 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79" returned: 0 in 0.924s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:15 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79 Jul 21 08:11:15 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:15 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-234be2e9-ec93-4178-bce0-3b973738dc79" returned: 0 in 0.516s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "cinder-quobyte-234be2e9-ec93-4178-bce0-3b973738dc79" released by "delete_volume" :: held 1.556s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Created reservations ['405c5e3b-41ad-4d77-a378-a8c405a9833b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:15 devstack cinder-volume[87372]: WARNING cinder.quota [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2069937627 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2069937627, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:11:15 devstack cinder-volume[87372]: WARNING cinder.quota [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2069937627 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2069937627, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:11:15 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Created reservations ['98a9b72e-7c7a-4c53-b7e2-26d6d6af5131', '3cfd7b4e-b13e-4084-b873-18af43813b48', '934a509a-dcee-412b-b418-2a3c0929896a', 'b528cee6-7c00-4da3-acea-48d76baeeec9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-dd07fa23-6019-4ec8-b492-4cf3c025fba8 req-0b74a63c-b66b-45dd-b9f8-1938e1c81cc2 tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-dd07fa23-6019-4ec8-b492-4cf3c025fba8 req-0b74a63c-b66b-45dd-b9f8-1938e1c81cc2 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-dd07fa23-6019-4ec8-b492-4cf3c025fba8 req-0b74a63c-b66b-45dd-b9f8-1938e1c81cc2 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Created reservations ['b5292df6-da8e-425e-907f-e428f3adf38c', 'd4329ba2-2c5b-49f2-b363-fa82a3f2ecdb', '050c9841-895b-4602-a235-b9d742a21cff', '59648324-8f5f-4110-9572-4fdd3aec6edd'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-dd07fa23-6019-4ec8-b492-4cf3c025fba8 req-0b74a63c-b66b-45dd-b9f8-1938e1c81cc2 tempest-ServerActionsTestOtherA-2076468163 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd484ef08-d8bb-448b-9dd6-fd1bcb52b4ce', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:11:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-dd07fa23-6019-4ec8-b492-4cf3c025fba8 req-0b74a63c-b66b-45dd-b9f8-1938e1c81cc2 tempest-ServerActionsTestOtherA-2076468163 None] attachment_update completed successfully. Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:16 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:16 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:17 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.514s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:17 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:11:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e9f9770e-679f-49a2-9208-1a4967da22b3 tempest-GroupsTest-351403737 None] Delete group completed successfully. Jul 21 08:11:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-830e3034-5975-4e48-b78c-a2f2ffa082f4 tempest-ServerActionsTestOtherA-2076468163 None] Terminate volume connection completed successfully. Jul 21 08:11:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-830e3034-5975-4e48-b78c-a2f2ffa082f4 tempest-ServerActionsTestOtherA-2076468163 None] Deleting attachment d484ef08-d8bb-448b-9dd6-fd1bcb52b4ce. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:11:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-1dc9312a-d95a-4de8-9522-97c57a1792b0 tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-1dc9312a-d95a-4de8-9522-97c57a1792b0 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-1dc9312a-d95a-4de8-9522-97c57a1792b0 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-1dc9312a-d95a-4de8-9522-97c57a1792b0 tempest-ServerActionsTestOtherA-2076468163 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a44bbd7-1f72-4385-9e0c-562010683c87', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:11:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-82991cad-59a1-4eb9-88fb-4b3b232cd278 req-1dc9312a-d95a-4de8-9522-97c57a1792b0 tempest-ServerActionsTestOtherA-2076468163 None] attachment_update completed successfully. Jul 21 08:11:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54995e2f-bdeb-4a6d-b3f8-c5b557df2d9d tempest-GroupsV320Test-1442765817 None] Group tempest-GroupsV320Test-Group-1810084309: creating Jul 21 08:11:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54995e2f-bdeb-4a6d-b3f8-c5b557df2d9d tempest-GroupsV320Test-1442765817 None] Group tempest-GroupsV320Test-Group-1810084309: created successfully Jul 21 08:11:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54995e2f-bdeb-4a6d-b3f8-c5b557df2d9d tempest-GroupsV320Test-1442765817 None] Create group completed successfully. Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Created reservations ['89604909-48f6-4aa4-8123-05e9382a0cbf'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:30 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:30 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:30 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.264s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:30 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:11:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-9a63b3a4-f4df-443a-8260-ed94c4745b0f tempest-GroupsV320Test-1442765817 None] Delete group completed successfully. Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=72,cinder:UPDATE=68,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=70,cinder:UPDATE=65,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Flow 'volume_create_manager' (f8a5856e-d35e-4e2b-80ea-d2cab7388fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51f967d-3b71-4342-8759-8ce5bc2ac188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51f967d-3b71-4342-8759-8ce5bc2ac188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2126516183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e03075d-100a-47e3-a789-041532002962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c4d7ea93644a19a17d15569ea36324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:40Z,use_quota=True,user_id='4bd3d21288634863ab93e99c2045655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14461f8-596a-4227-84f1-cf852669f990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14461f8-596a-4227-84f1-cf852669f990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1d124-fb02-4940-840f-95ba4e605e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a1d124-fb02-4940-840f-95ba4e605e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e03075d-100a-47e3-a789-041532002962', 'volume_name': 'volume-3e03075d-100a-47e3-a789-041532002962', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2865e82a-af12-4341-9844-ea264eba3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2865e82a-af12-4341-9844-ea264eba3521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a244e1e7-dd85-4742-889e-4d99d150286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume 3e03075d-100a-47e3-a789-041532002962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e03075d-100a-47e3-a789-041532002962', 'volume_size': 1} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2126516183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e03075d-100a-47e3-a789-041532002962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c4d7ea93644a19a17d15569ea36324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:40Z,use_quota=True,user_id='4bd3d21288634863ab93e99c2045655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Creating volume 3e03075d-100a-47e3-a789-041532002962 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:11:39 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:11:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:39 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 1073741824 Jul 21 08:11:39 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:40 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 1073741824" returned: 0 in 0.673s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:40 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 Jul 21 08:11:40 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:40 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a244e1e7-dd85-4742-889e-4d99d150286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e03075d-100a-47e3-a789-041532002962', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286f1baa-d5b0-40c0-9d45-52feea42631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume volume-3e03075d-100a-47e3-a789-041532002962 (3e03075d-100a-47e3-a789-041532002962): created successfully Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286f1baa-d5b0-40c0-9d45-52feea42631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Flow 'volume_create_manager' (f8a5856e-d35e-4e2b-80ea-d2cab7388fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-60852c7e-c3a1-4260-a996-b8fed0109c26 tempest-VolumeQuotasAdminTestJSON-281903289 None] Created volume successfully. Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "cinder-3e03075d-100a-47e3-a789-041532002962-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "cinder-3e03075d-100a-47e3-a789-041532002962-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "cinder-quobyte-3e03075d-100a-47e3-a789-041532002962" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "cinder-quobyte-3e03075d-100a-47e3-a789-041532002962" acquired by "delete_volume" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3b8e90-42d8-4496-ae9e-5b6861011d87]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:11:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:42 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 Jul 21 08:11:42 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:42 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:42 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962 Jul 21 08:11:42 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:42 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3e03075d-100a-47e3-a789-041532002962" returned: 0 in 0.277s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "cinder-quobyte-3e03075d-100a-47e3-a789-041532002962" released by "delete_volume" :: held 0.698s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Created reservations ['05bdb11e-af65-4e24-98f6-8c7ee41af381', '555d5942-6931-40b0-ac57-7cb71f4ac76d', '4865523c-8d3d-494a-8c4a-1901d6d7a925', '18317f21-46ac-4a36-8a1f-8d7294131dba'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:42 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:42 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:43 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.612s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:43 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:11:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Deleted volume successfully. Jul 21 08:11:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-42355c4e-2f0a-4fba-9173-1238ed461e47 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "cinder-3e03075d-100a-47e3-a789-041532002962-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Flow 'volume_create_manager' (1e1b51a2-d209-41e7-9427-19be9494d03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422ffa95-bd0b-4ec3-8681-f37f148715a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422ffa95-bd0b-4ec3-8681-f37f148715a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-885402711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7079306b-cc67-409f-b536-a53859a45805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c4d7ea93644a19a17d15569ea36324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:44Z,use_quota=True,user_id='4bd3d21288634863ab93e99c2045655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d152c2c-f6b6-4a0b-94cc-4b75c7372cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d152c2c-f6b6-4a0b-94cc-4b75c7372cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be384a91-6a58-4e68-afbf-e180c63dab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be384a91-6a58-4e68-afbf-e180c63dab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7079306b-cc67-409f-b536-a53859a45805', 'volume_name': 'volume-7079306b-cc67-409f-b536-a53859a45805', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db2185-c1b7-4f77-ae06-c9f74dc0a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36db2185-c1b7-4f77-ae06-c9f74dc0a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66dc905-f399-43aa-bf7d-10e7b52c95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:44 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume 7079306b-cc67-409f-b536-a53859a45805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7079306b-cc67-409f-b536-a53859a45805', 'volume_size': 1} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-885402711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7079306b-cc67-409f-b536-a53859a45805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c4d7ea93644a19a17d15569ea36324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:11:44Z,use_quota=True,user_id='4bd3d21288634863ab93e99c2045655f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Creating volume 7079306b-cc67-409f-b536-a53859a45805 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:11:44 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:44 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 1073741824 Jul 21 08:11:44 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-700c29ec-9375-462a-8897-1a0db378f603 req-6be1546f-6095-43a9-9f97-b85323b5fe7d tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:45 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 1073741824" returned: 0 in 0.479s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:45 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 Jul 21 08:11:45 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:45 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805" returned: 0 in 0.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-700c29ec-9375-462a-8897-1a0db378f603 req-6be1546f-6095-43a9-9f97-b85323b5fe7d tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.503s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66dc905-f399-43aa-bf7d-10e7b52c95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7079306b-cc67-409f-b536-a53859a45805', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ec03d0-4fc6-416b-b92f-a036ca74a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-700c29ec-9375-462a-8897-1a0db378f603 req-6be1546f-6095-43a9-9f97-b85323b5fe7d tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:45 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Volume volume-7079306b-cc67-409f-b536-a53859a45805 (7079306b-cc67-409f-b536-a53859a45805): created successfully Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ec03d0-4fc6-416b-b92f-a036ca74a791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Flow 'volume_create_manager' (1e1b51a2-d209-41e7-9427-19be9494d03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:11:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d62f08d2-76a4-4a95-b7e1-5ebdc9609a43 tempest-VolumeQuotasAdminTestJSON-281903289 None] Created volume successfully. Jul 21 08:11:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-700c29ec-9375-462a-8897-1a0db378f603 req-6be1546f-6095-43a9-9f97-b85323b5fe7d tempest-TaggedAttachmentsTest-1508866370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9040e0ec-a4c0-4ce0-9353-0260075be7a5', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:11:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-700c29ec-9375-462a-8897-1a0db378f603 req-6be1546f-6095-43a9-9f97-b85323b5fe7d tempest-TaggedAttachmentsTest-1508866370 None] attachment_update completed successfully. Jul 21 08:11:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f5e0ad66-a9e2-4519-9902-53c4e3acac64 tempest-VolumeQuotasAdminTestJSON-1312744435 None] Transfer volume completed successfully. Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Acquiring lock "cinder-7079306b-cc67-409f-b536-a53859a45805-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "cinder-7079306b-cc67-409f-b536-a53859a45805-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Acquiring lock "cinder-quobyte-7079306b-cc67-409f-b536-a53859a45805" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "cinder-quobyte-7079306b-cc67-409f-b536-a53859a45805" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa68d2-37bf-4241-9c31-6af5228d8ee4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:11:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:48 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 Jul 21 08:11:48 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:48 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805" returned: 0 in 0.507s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:48 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805 Jul 21 08:11:48 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-fe53c852-8848-44c6-9759-8a55b9775af3 req-8ed28ca2-b2c3-4d82-bd5a-dcd387febe1c tempest-TaggedAttachmentsTest-1508866370 None] Terminate volume connection completed successfully. Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fe53c852-8848-44c6-9759-8a55b9775af3 req-8ed28ca2-b2c3-4d82-bd5a-dcd387febe1c tempest-TaggedAttachmentsTest-1508866370 None] Deleting attachment 9040e0ec-a4c0-4ce0-9353-0260075be7a5. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:11:48 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7079306b-cc67-409f-b536-a53859a45805" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "cinder-quobyte-7079306b-cc67-409f-b536-a53859a45805" released by "delete_volume" :: held 0.930s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Created reservations ['f87222fa-e210-42a0-8385-c67138ecfa65', '77a55698-4ae3-47ca-b449-86e96ff93ea5', '181b96d6-1e44-4a2c-a30e-be8463aaaaca', '60f309eb-aa4c-45d9-820d-4372a30258e7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:48 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:48 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:49 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:49 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:11:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Deleted volume successfully. Jul 21 08:11:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6f1fa3a8-1498-489a-92fc-5270e3e62631 tempest-VolumeQuotasAdminTestJSON-108710233 None] Lock "cinder-7079306b-cc67-409f-b536-a53859a45805-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:11:52 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:11:52 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:11:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-f7b980de-6d84-459a-9089-fd7a90a01793 req-7f30daf6-b20d-4cfa-a6f9-2babe48d456b tempest-ServerActionsTestOtherA-2076468163 None] Terminate volume connection completed successfully. Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-f7b980de-6d84-459a-9089-fd7a90a01793 req-7f30daf6-b20d-4cfa-a6f9-2babe48d456b tempest-ServerActionsTestOtherA-2076468163 None] Deleting attachment 5a44bbd7-1f72-4385-9e0c-562010683c87. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:11:52 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:11:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "cinder-212bc318-aad9-4dd7-bec5-cd29e04aad4e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "cinder-212bc318-aad9-4dd7-bec5-cd29e04aad4e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "cinder-quobyte-212bc318-aad9-4dd7-bec5-cd29e04aad4e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "cinder-quobyte-212bc318-aad9-4dd7-bec5-cd29e04aad4e" acquired by "delete_volume" :: waited 0.041s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c5e38f-eadf-4953-a298-8af61304c657]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:02 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e Jul 21 08:12:02 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:02 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e" returned: 0 in 0.673s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:02 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e Jul 21 08:12:02 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:02 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-212bc318-aad9-4dd7-bec5-cd29e04aad4e" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "cinder-quobyte-212bc318-aad9-4dd7-bec5-cd29e04aad4e" released by "delete_volume" :: held 1.144s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:02 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Created reservations ['1781cb0a-d587-4b58-9246-1fa9d96e4ddc', '5b63218e-32d7-406d-b7b5-89d5c36fc10c', '3e829f72-6133-48b2-baca-f4ec3c546554', '518b6fba-ae02-4dfa-8bd3-b53e00d12eab'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:03 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:03 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:03 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.332s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:03 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Deleted volume successfully. Jul 21 08:12:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c201f26b-69f7-4809-9ccc-d84d89af43a7 tempest-ServerActionsTestOtherA-2076468163 None] Lock "cinder-212bc318-aad9-4dd7-bec5-cd29e04aad4e-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "cinder-8fa1c6ff-9d04-4c42-8942-e6a0262ba290-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "cinder-8fa1c6ff-9d04-4c42-8942-e6a0262ba290-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "cinder-quobyte-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "cinder-quobyte-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18f578-54ef-43c7-96f4-26189fa264f1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:04 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 Jul 21 08:12:04 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:12:05 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Flow 'volume_create_manager' (3ca9174d-de25-4ae9-b252-32e113d88b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34777d-8e9b-4ae4-b004-8ecc32532b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" returned: 0 in 0.833s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:05 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290 Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34777d-8e9b-4ae4-b004-8ecc32532b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-792331850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0972e45-fad3-46c5-972e-64abff972635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64033750679c4235bf1c02207f284546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:05Z,use_quota=True,user_id='edd3b59b7d334d29825aacc9e65bf36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4172b040-2fde-4a0d-b48d-c776e6e60d4c),volume_type_id=4172b040-2fde-4a0d-b48d-c776e6e60d4c)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a297729d-2fca-40f4-8885-4e4f62ef42f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a297729d-2fca-40f4-8885-4e4f62ef42f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:05 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910f242-7b5d-44f9-a3bf-c3872d37aa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c910f242-7b5d-44f9-a3bf-c3872d37aa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0972e45-fad3-46c5-972e-64abff972635', 'volume_name': 'volume-a0972e45-fad3-46c5-972e-64abff972635', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a73c65-863d-405d-b01e-5626813cd32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a73c65-863d-405d-b01e-5626813cd32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd283ee4-513f-473f-981c-7cc7b042425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:05 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Volume a0972e45-fad3-46c5-972e-64abff972635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0972e45-fad3-46c5-972e-64abff972635', 'volume_size': 1} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-792331850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0972e45-fad3-46c5-972e-64abff972635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64033750679c4235bf1c02207f284546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:05Z,use_quota=True,user_id='edd3b59b7d334d29825aacc9e65bf36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4172b040-2fde-4a0d-b48d-c776e6e60d4c),volume_type_id=4172b040-2fde-4a0d-b48d-c776e6e60d4c)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Creating volume a0972e45-fad3-46c5-972e-64abff972635 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:12:05 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:12:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:05 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 1073741824 Jul 21 08:12:05 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:06 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" returned: 0 in 0.524s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "cinder-quobyte-8fa1c6ff-9d04-4c42-8942-e6a0262ba290" released by "delete_volume" :: held 1.455s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Created reservations ['026ef55c-3a71-45bf-be2d-3bf130c19b76', 'bb7e4d8d-5823-4579-a5d6-89c8133fbcc7', 'dff74559-02ec-4340-9d50-615e1354c9e7', '47df14cf-1211-4eaa-8c25-e048b8c90572'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:06 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:06 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:06 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 1073741824" returned: 0 in 0.856s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:06 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 Jul 21 08:12:06 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:06 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:06 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Deleted volume successfully. Jul 21 08:12:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21102193-530c-4383-b7e2-8b19ae37b249 tempest-TaggedAttachmentsTest-1508866370 None] Lock "cinder-8fa1c6ff-9d04-4c42-8942-e6a0262ba290-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:07 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd283ee4-513f-473f-981c-7cc7b042425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0972e45-fad3-46c5-972e-64abff972635', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af21842-1207-4b3e-8e63-dd959a57237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Volume volume-a0972e45-fad3-46c5-972e-64abff972635 (a0972e45-fad3-46c5-972e-64abff972635): created successfully Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af21842-1207-4b3e-8e63-dd959a57237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Flow 'volume_create_manager' (3ca9174d-de25-4ae9-b252-32e113d88b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-fbb69725-f5e3-4c6d-8b02-298de235ccef tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Created volume successfully. Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:08 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:08 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:08 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:08 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d5fd7c1c-7911-45e5-9fa4-25ddf5d5c839 tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Retype volume completed successfully. Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "cinder-a0972e45-fad3-46c5-972e-64abff972635-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "cinder-a0972e45-fad3-46c5-972e-64abff972635-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "cinder-quobyte-a0972e45-fad3-46c5-972e-64abff972635" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "cinder-quobyte-a0972e45-fad3-46c5-972e-64abff972635" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b1ad1-771d-4552-ba5b-044cfd585fba]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:09 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 Jul 21 08:12:09 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:09 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:09 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635 Jul 21 08:12:09 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:10 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a0972e45-fad3-46c5-972e-64abff972635" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "cinder-quobyte-a0972e45-fad3-46c5-972e-64abff972635" released by "delete_volume" :: held 0.783s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:10 devstack cinder-volume[87372]: WARNING cinder.quota [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:12:10 devstack cinder-volume[87372]: WARNING cinder.quota [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Created reservations ['3cc67977-bcef-4dea-9998-d68452966392', '32e0d6f3-512c-4d2e-9d38-91a6ebd3d71c', '848e8b1c-14af-4d5c-b794-b591464e3f64', '1633d0ae-5609-4c0d-ae86-93a75e789465'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:10 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:10 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:10 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Deleted volume successfully. Jul 21 08:12:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-02e75581-9a41-4bb5-81ab-ed8279cb945c tempest-VolumeRetypeWithoutMigrationTest-1718981976 None] Lock "cinder-a0972e45-fad3-46c5-972e-64abff972635-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:20 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=61,cinder:INSERT=10,cinder:SELECT=48,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:12:20 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=45,cinder:UPDATE=48,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (d19e52a8-4fc4-4e9b-8316-816fed7050e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9d9a5f-322b-49d8-b96a-bf64d997bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9d9a5f-322b-49d8-b96a-bf64d997bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978182219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926ff5d3-1e29-4536-acef-cb5d42c9fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:23Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f382ec7a-22a5-4bd6-a392-f26646b7b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f382ec7a-22a5-4bd6-a392-f26646b7b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d003f8-20ea-4c67-9149-ea72d2041079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d003f8-20ea-4c67-9149-ea72d2041079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926ff5d3-1e29-4536-acef-cb5d42c9fdc7', 'volume_name': 'volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef82b71a-f89e-4b88-817f-21650f06b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef82b71a-f89e-4b88-817f-21650f06b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41aedd-92d3-41b0-9405-299db23cbd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Volume 926ff5d3-1e29-4536-acef-cb5d42c9fdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7', 'volume_size': 1} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978182219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926ff5d3-1e29-4536-acef-cb5d42c9fdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:23Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Creating volume 926ff5d3-1e29-4536-acef-cb5d42c9fdc7 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:12:23 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:23 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 1073741824 Jul 21 08:12:23 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:23 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 1073741824" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:23 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 Jul 21 08:12:23 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:24 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd41aedd-92d3-41b0-9405-299db23cbd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f22764-ba6b-4df3-8668-afcac7256e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Volume volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 (926ff5d3-1e29-4536-acef-cb5d42c9fdc7): created successfully Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f22764-ba6b-4df3-8668-afcac7256e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (d19e52a8-4fc4-4e9b-8316-816fed7050e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3b259d4e-8ee3-4b24-8e5b-44cd06cab8b8 tempest-AttachVolumeNegativeTest-1805662753 None] Created volume successfully. Jul 21 08:12:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-da7e6be9-9a62-4bea-a6ab-0ee194a18f82 req-d0664004-a12d-4a50-9dd6-1d41ad02fac5 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-da7e6be9-9a62-4bea-a6ab-0ee194a18f82 req-d0664004-a12d-4a50-9dd6-1d41ad02fac5 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-da7e6be9-9a62-4bea-a6ab-0ee194a18f82 req-d0664004-a12d-4a50-9dd6-1d41ad02fac5 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-da7e6be9-9a62-4bea-a6ab-0ee194a18f82 req-d0664004-a12d-4a50-9dd6-1d41ad02fac5 tempest-AttachVolumeNegativeTest-1805662753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77058357-e322-462b-a477-805cd8316d7f', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:12:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-da7e6be9-9a62-4bea-a6ab-0ee194a18f82 req-d0664004-a12d-4a50-9dd6-1d41ad02fac5 tempest-AttachVolumeNegativeTest-1805662753 None] attachment_update completed successfully. Jul 21 08:12:36 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:12:36 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Flow 'volume_create_manager' (922269aa-69e3-483e-b0f5-2c8e0bc9b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb57a5-44de-41d2-a458-92977aeb4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26eb57a5-44de-41d2-a458-92977aeb4c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-202216542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925dd638-8959-430e-af46-6a9f7220050d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31132dfdddb4c60b9ecb90df79f949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:38Z,use_quota=True,user_id='728c46a0ced9417784e5cea8cf981f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ce30c-2373-4a46-887c-0cc031f87a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ce30c-2373-4a46-887c-0cc031f87a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299bc056-6e73-4900-944f-7eb52d56707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299bc056-6e73-4900-944f-7eb52d56707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925dd638-8959-430e-af46-6a9f7220050d', 'volume_name': 'volume-925dd638-8959-430e-af46-6a9f7220050d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c614470-aa80-462e-a63e-17f61cee1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c614470-aa80-462e-a63e-17f61cee1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dffb9c-fb3c-483e-a2d0-ff1aed0dcafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Volume 925dd638-8959-430e-af46-6a9f7220050d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925dd638-8959-430e-af46-6a9f7220050d', 'volume_size': 1} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-202216542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925dd638-8959-430e-af46-6a9f7220050d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31132dfdddb4c60b9ecb90df79f949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:12:38Z,use_quota=True,user_id='728c46a0ced9417784e5cea8cf981f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Creating volume 925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:12:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:12:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:37 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d 1073741824 Jul 21 08:12:37 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:38 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d 1073741824" returned: 0 in 0.838s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:38 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d Jul 21 08:12:38 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:38 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:12:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dffb9c-fb3c-483e-a2d0-ff1aed0dcafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925dd638-8959-430e-af46-6a9f7220050d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784f7054-56ae-4b7c-9c4d-235912414416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:12:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Volume volume-925dd638-8959-430e-af46-6a9f7220050d (925dd638-8959-430e-af46-6a9f7220050d): created successfully Jul 21 08:12:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784f7054-56ae-4b7c-9c4d-235912414416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:12:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Flow 'volume_create_manager' (922269aa-69e3-483e-b0f5-2c8e0bc9b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:12:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2838d199-4633-4ec3-a4df-5ceca234a12f tempest-SnapshotMetadataTestJSON-157332735 None] Created volume successfully. Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Creating offline snapshot 9cfea003-2b83-4a0d-a210-56bc5e57a851 of volume 925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[266931c5-bb32-4ac5-9637-7b0dfb448ae9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:40 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d Jul 21 08:12:40 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:40 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d" returned: 0 in 0.537s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:40 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 1G Jul 21 08:12:40 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:41 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 1G" returned: 0 in 0.621s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925dd638-8959-430e-af46-6a9f7220050d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:41 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925dd638-8959-430e-af46-6a9f7220050d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 Jul 21 08:12:41 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:41 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-925dd638-8959-430e-af46-6a9f7220050d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851" returned: 0 in 0.364s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:41 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 is being set with open permissions: ugo+rw Jul 21 08:12:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:41 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 Jul 21 08:12:41 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:42 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:42 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info Jul 21 08:12:42 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:42 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info" returned: 0 in 0.347s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:42 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info is being set with open permissions: ugo+rw Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:42 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info Jul 21 08:12:42 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:42 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.info" returned: 0 in 0.417s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-abe4558b-dd61-4a77-855e-498a45cfb421 tempest-SnapshotMetadataTestJSON-157332735 None] Create snapshot completed successfully Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "cinder-9cfea003-2b83-4a0d-a210-56bc5e57a851-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-9cfea003-2b83-4a0d-a210-56bc5e57a851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "cinder-quobyte-9cfea003-2b83-4a0d-a210-56bc5e57a851" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-9cfea003-2b83-4a0d-a210-56bc5e57a851" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Deleting offline snapshot 9cfea003-2b83-4a0d-a210-56bc5e57a851 of volume 925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] snapshot_file for this snap is: volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab4015-5abf-4284-9387-4cf7961850ae]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:46 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 Jul 21 08:12:46 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:47 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851" returned: 0 in 1.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-925dd638-8959-430e-af46-6a9f7220050d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:12:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e2bcd-95d0-4281-85e9-4b0b0878c7ee]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:48 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d Jul 21 08:12:48 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:49 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d" returned: 0 in 1.140s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:49 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 Jul 21 08:12:49 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:50 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851" returned: 0 in 1.009s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:50 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851 Jul 21 08:12:50 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:50 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d.9cfea003-2b83-4a0d-a210-56bc5e57a851" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-9cfea003-2b83-4a0d-a210-56bc5e57a851" released by "_delete_snapshot" :: held 4.301s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" released by "delete_snapshot" :: held 4.400s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:50 devstack cinder-volume[87372]: WARNING cinder.quota [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Created reservations ['dc93e317-e465-437b-8937-483b9617c9ca', '141205ec-566e-4dad-bfbd-f95ea2f9b8ad', '722f08a5-90af-475e-91f3-6727c52b7963', '35f5180d-b9b5-48a7-91f4-9e2233a0b4b9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:12:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Delete snapshot completed successfully. Jul 21 08:12:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8a02a59-8b17-479e-9ec8-b737fc84dae9 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-9cfea003-2b83-4a0d-a210-56bc5e57a851-delete_snapshot" released by "delete_snapshot" :: held 4.775s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "cinder-925dd638-8959-430e-af46-6a9f7220050d-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-925dd638-8959-430e-af46-6a9f7220050d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1866f1-9e44-4723-8a90-c53483ad083a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:52 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:52 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:52 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d Jul 21 08:12:52 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:53 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.917s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 8 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:12:53 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d" returned: 0 in 1.282s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:53 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d Jul 21 08:12:53 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:54 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-925dd638-8959-430e-af46-6a9f7220050d" returned: 0 in 0.522s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-quobyte-925dd638-8959-430e-af46-6a9f7220050d" released by "delete_volume" :: held 1.953s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Created reservations ['6738b44a-3eb9-45b5-ad76-beb3dc5d2769', '09783cb3-7c36-4b0e-8002-85e213a664aa', 'a528de17-98bc-4ec1-869c-ebfebfadaff6', 'bdfac86d-7eec-4a25-b607-156a15d6850c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:12:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:12:54 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:12:54 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:12:55 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Jul 21 08:12:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.768s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:12:55 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:12:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Deleted volume successfully. Jul 21 08:12:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c8509d98-5873-406f-ab7a-ef3431af3b91 tempest-SnapshotMetadataTestJSON-157332735 None] Lock "cinder-925dd638-8959-430e-af46-6a9f7220050d-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:04 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:INSERT=6 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:13:05 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:13:05 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (43a1c98f-882d-4c55-80b5-49f81cfd3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297adc6f-dd45-41e9-9dde-ab0012d6477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297adc6f-dd45-41e9-9dde-ab0012d6477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039051674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ed28dd-93cf-4b93-a767-e48f373e7693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121ec02e37214d1da9427c279744b84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:06Z,use_quota=True,user_id='627f1b925adb42baae51882423a611ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b26cbf-1ad0-4a6d-aa57-e041adf963bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b26cbf-1ad0-4a6d-aa57-e041adf963bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da8ff36-4ed1-439e-90ea-4a4b04c3c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da8ff36-4ed1-439e-90ea-4a4b04c3c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ed28dd-93cf-4b93-a767-e48f373e7693', 'volume_name': 'volume-63ed28dd-93cf-4b93-a767-e48f373e7693', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5b0a7c-4042-49ab-bba7-46580e386b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5b0a7c-4042-49ab-bba7-46580e386b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6be841-e41c-40ad-968a-ce051efcbeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Volume 63ed28dd-93cf-4b93-a767-e48f373e7693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ed28dd-93cf-4b93-a767-e48f373e7693', 'volume_size': 1} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039051674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ed28dd-93cf-4b93-a767-e48f373e7693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121ec02e37214d1da9427c279744b84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:06Z,use_quota=True,user_id='627f1b925adb42baae51882423a611ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Creating volume 63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:06 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:06 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 1073741824 Jul 21 08:13:06 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:06 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 1073741824" returned: 0 in 0.895s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:07 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 Jul 21 08:13:07 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:07 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693" returned: 0 in 0.495s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6be841-e41c-40ad-968a-ce051efcbeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ed28dd-93cf-4b93-a767-e48f373e7693', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9049aec-ccd2-4f3a-9885-2af523ba7cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Volume volume-63ed28dd-93cf-4b93-a767-e48f373e7693 (63ed28dd-93cf-4b93-a767-e48f373e7693): created successfully Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9049aec-ccd2-4f3a-9885-2af523ba7cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (43a1c98f-882d-4c55-80b5-49f81cfd3a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-86210873-b844-47c1-90ff-035487f36a3b tempest-VolumesDeleteCascade-626276688 None] Created volume successfully. Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Creating offline snapshot def59916-cf76-456e-b66a-d6924a5165cb of volume 63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c077e2-2ca7-4def-90de-6e0c006faf7f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:08 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 Jul 21 08:13:08 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:08 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693" returned: 0 in 0.363s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:08 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb 1G Jul 21 08:13:08 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:09 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb 1G" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:09 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:09 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:09 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:09 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb is being set with open permissions: ugo+rw Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:09 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:09 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Flow 'volume_create_manager' (0516fe13-c126-4ca2-abb6-c3deec8d4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b307115c-f36d-4b58-b8bf-4a8fc9ad6213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:09 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b307115c-f36d-4b58-b8bf-4a8fc9ad6213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-581059044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5bccdc-a16a-4245-ae58-8ed5345c830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47ba6bd3b6548a38d4d0c5cfd3c35f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:10Z,use_quota=True,user_id='84bc6013ca96421e93b1d5dfd96c84b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57755e4-51e4-4578-9b5a-050eff4ef5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57755e4-51e4-4578-9b5a-050eff4ef5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651492bf-204d-48f2-a7bd-f0f4bcafc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651492bf-204d-48f2-a7bd-f0f4bcafc30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5bccdc-a16a-4245-ae58-8ed5345c830b', 'volume_name': 'volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be3b736-67d9-404b-abb9-f45568244018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be3b736-67d9-404b-abb9-f45568244018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfde115-bec2-4010-973f-f6ab87756ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Volume 3b5bccdc-a16a-4245-ae58-8ed5345c830b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b', 'volume_size': 1} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:09 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info Jul 21 08:13:09 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:10 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:10 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info is being set with open permissions: ugo+rw Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:10 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info Jul 21 08:13:10 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:10 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.info" returned: 0 in 0.236s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-581059044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5bccdc-a16a-4245-ae58-8ed5345c830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47ba6bd3b6548a38d4d0c5cfd3c35f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:10Z,use_quota=True,user_id='84bc6013ca96421e93b1d5dfd96c84b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Creating volume 3b5bccdc-a16a-4245-ae58-8ed5345c830b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:10 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b 1073741824 Jul 21 08:13:10 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c62c0b8c-943a-4f3b-bb6b-2ec6c4c132ad tempest-VolumesDeleteCascade-626276688 None] Create snapshot completed successfully Jul 21 08:13:10 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b 1073741824" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:10 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b Jul 21 08:13:10 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:11 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfde115-bec2-4010-973f-f6ab87756ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9418832b-1e48-407f-bb60-5d3f8f9ff92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Volume volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b (3b5bccdc-a16a-4245-ae58-8ed5345c830b): created successfully Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9418832b-1e48-407f-bb60-5d3f8f9ff92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Flow 'volume_create_manager' (0516fe13-c126-4ca2-abb6-c3deec8d4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-166ae9bf-96c3-4a60-9a8c-8fdb29825359 tempest-ServersNegativeTestJSON-17123536 None] Created volume successfully. Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Creating offline snapshot 235f77a4-b1cf-4262-a0c8-49ee27f96408 of volume 63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5066f-7ffe-48f0-b8d4-f6c9b986a963]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:11 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:11 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:12 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.604s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ed28dd-93cf-4b93-a767-e48f373e7693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:12 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 1G Jul 21 08:13:12 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:12 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 1G" returned: 0 in 0.572s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:12 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 Jul 21 08:13:12 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:13 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408" returned: 0 in 0.366s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:13 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 is being set with open permissions: ugo+rw Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:13 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 Jul 21 08:13:13 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:13 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408" returned: 0 in 0.319s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Flow 'volume_create_manager' (ceec93a2-3519-467e-89f6-8eaa4c2e4ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0d8895-1b22-40df-8f6f-41d880ba3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e2e6dc5b-5cc1-4cbf-8e07-149950ff9be2 tempest-VolumesDeleteCascade-626276688 None] Create snapshot completed successfully Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0d8895-1b22-40df-8f6f-41d880ba3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-982851476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748996b4-f93a-4179-891a-c27abff9c0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47ba6bd3b6548a38d4d0c5cfd3c35f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:14Z,use_quota=True,user_id='84bc6013ca96421e93b1d5dfd96c84b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4891e2e7-80c6-4e0b-a940-79722ebfa402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4891e2e7-80c6-4e0b-a940-79722ebfa402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcbb6cd-bc50-442e-abc8-c06519f02286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcbb6cd-bc50-442e-abc8-c06519f02286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748996b4-f93a-4179-891a-c27abff9c0ff', 'volume_name': 'volume-748996b4-f93a-4179-891a-c27abff9c0ff', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159335c4-a0a2-4114-8fa9-049d997203f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159335c4-a0a2-4114-8fa9-049d997203f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c774763-5690-4323-88e9-0e1d3cc75c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Volume 748996b4-f93a-4179-891a-c27abff9c0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748996b4-f93a-4179-891a-c27abff9c0ff', 'volume_size': 1} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-982851476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748996b4-f93a-4179-891a-c27abff9c0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47ba6bd3b6548a38d4d0c5cfd3c35f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:14Z,use_quota=True,user_id='84bc6013ca96421e93b1d5dfd96c84b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Creating volume 748996b4-f93a-4179-891a-c27abff9c0ff {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:13 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff 1073741824 Jul 21 08:13:13 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:14 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff 1073741824" returned: 0 in 0.516s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:14 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff Jul 21 08:13:14 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:14 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c774763-5690-4323-88e9-0e1d3cc75c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748996b4-f93a-4179-891a-c27abff9c0ff', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55608c0-b255-4273-83ac-d746d0f40c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Volume volume-748996b4-f93a-4179-891a-c27abff9c0ff (748996b4-f93a-4179-891a-c27abff9c0ff): created successfully Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e55608c0-b255-4273-83ac-d746d0f40c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Flow 'volume_create_manager' (ceec93a2-3519-467e-89f6-8eaa4c2e4ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4815e389-5c9e-42fa-a55f-4a112bcb115b tempest-ServersNegativeTestJSON-17123536 None] Created volume successfully. Jul 21 08:13:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-63ed28dd-93cf-4b93-a767-e48f373e7693-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-63ed28dd-93cf-4b93-a767-e48f373e7693-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Performing cascade delete. {{(pid=87372) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-235f77a4-b1cf-4262-a0c8-49ee27f96408-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-235f77a4-b1cf-4262-a0c8-49ee27f96408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-235f77a4-b1cf-4262-a0c8-49ee27f96408" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-235f77a4-b1cf-4262-a0c8-49ee27f96408" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Deleting offline snapshot 235f77a4-b1cf-4262-a0c8-49ee27f96408 of volume 63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] snapshot_file for this snap is: volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6e225a-2a64-4185-b950-b64a2b91d118]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:15 devstack sudo[92497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 Jul 21 08:13:15 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:15 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ed28dd-93cf-4b93-a767-e48f373e7693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3c883-47a5-49a9-a0e7-ad00d728f12b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:15 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:15 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-acc12e9f-12cf-4319-92a4-d90606f546bd req-82d62af7-37ea-453f-80d3-d9b58c817a9f tempest-AttachVolumeNegativeTest-1805662753 None] Terminate volume connection completed successfully. Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-acc12e9f-12cf-4319-92a4-d90606f546bd req-82d62af7-37ea-453f-80d3-d9b58c817a9f tempest-AttachVolumeNegativeTest-1805662753 None] Deleting attachment 77058357-e322-462b-a477-805cd8316d7f. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:13:16 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.450s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ed28dd-93cf-4b93-a767-e48f373e7693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:16 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 Jul 21 08:13:16 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "cinder-748996b4-f93a-4179-891a-c27abff9c0ff-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-748996b4-f93a-4179-891a-c27abff9c0ff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "cinder-quobyte-748996b4-f93a-4179-891a-c27abff9c0ff" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-quobyte-748996b4-f93a-4179-891a-c27abff9c0ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2a644-4ad5-4764-aec2-a2fd222ba1a3]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:16 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff Jul 21 08:13:16 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:16 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408" returned: 0 in 0.474s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:16 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408 Jul 21 08:13:16 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:16 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:16 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff Jul 21 08:13:16 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:16 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.235f77a4-b1cf-4262-a0c8-49ee27f96408" returned: 0 in 0.259s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-235f77a4-b1cf-4262-a0c8-49ee27f96408" released by "_delete_snapshot" :: held 1.750s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" released by "delete_snapshot" :: held 1.785s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['44d1d2de-0fcd-46b0-83cc-07dccc4722a2', 'fdc62a11-a023-44ac-87d6-f400a9df7d40', 'b82df39b-219d-44c6-9190-e9091b6ec347', '822e8ce5-4701-4245-8e6c-d018d069e093'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:17 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-748996b4-f93a-4179-891a-c27abff9c0ff" returned: 0 in 0.305s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-quobyte-748996b4-f93a-4179-891a-c27abff9c0ff" released by "delete_volume" :: held 0.738s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Delete snapshot completed successfully. Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-235f77a4-b1cf-4262-a0c8-49ee27f96408-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-def59916-cf76-456e-b66a-d6924a5165cb-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-def59916-cf76-456e-b66a-d6924a5165cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Created reservations ['d8a63819-304d-46f9-bbd8-fbb99dd9e26c', 'b6789792-6631-4ad8-8f67-2d9bfbc43906', 'b7b9b984-8cff-4627-bf6b-0e3cd6f25aed', 'f10d5002-4104-4762-9205-63d525fcb038'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-def59916-cf76-456e-b66a-d6924a5165cb" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-def59916-cf76-456e-b66a-d6924a5165cb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Deleting offline snapshot def59916-cf76-456e-b66a-d6924a5165cb of volume 63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] snapshot_file for this snap is: volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb721dc1-6973-40c3-90f8-7e00074ab6cb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:17 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:17 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:17 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:17 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "cinder-3b5bccdc-a16a-4245-ae58-8ed5345c830b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-3b5bccdc-a16a-4245-ae58-8ed5345c830b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "cinder-quobyte-3b5bccdc-a16a-4245-ae58-8ed5345c830b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-quobyte-3b5bccdc-a16a-4245-ae58-8ed5345c830b" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:17 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.364s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Deleted volume successfully. Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c87e77-0c0b-45a1-987c-30b731ac0003]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d131b788-0b4a-4dc4-a19f-b154480ad2a9 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-748996b4-f93a-4179-891a-c27abff9c0ff-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:17 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.587s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ed28dd-93cf-4b93-a767-e48f373e7693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e503e16-7e0b-4efc-982d-3dcece9a69fa]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:17 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b Jul 21 08:13:17 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:18 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 Jul 21 08:13:18 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:18 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b" returned: 0 in 0.448s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:18 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b Jul 21 08:13:18 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:18 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693" returned: 0 in 0.452s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:18 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:18 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:18 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3b5bccdc-a16a-4245-ae58-8ed5345c830b" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-quobyte-3b5bccdc-a16a-4245-ae58-8ed5345c830b" released by "delete_volume" :: held 0.849s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Created reservations ['78450dc4-fcd5-48fa-b9e2-c0e77a38cb8d', 'd6c9dde3-f383-4862-907e-689586e866dc', '5dce75e4-3b09-45af-90e2-11001f5f11c6', '8fd0eb35-e623-4ba6-b5e3-66dc88d20aff'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:18 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:18 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:18 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.457s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:18 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb Jul 21 08:13:18 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:19 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.322s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Deleted volume successfully. Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d12a710d-236c-4ca6-8246-3b53adc70e76 tempest-ServersNegativeTestJSON-17123536 None] Lock "cinder-3b5bccdc-a16a-4245-ae58-8ed5345c830b-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:19 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693.def59916-cf76-456e-b66a-d6924a5165cb" returned: 0 in 0.362s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-def59916-cf76-456e-b66a-d6924a5165cb" released by "_delete_snapshot" :: held 2.018s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" released by "delete_snapshot" :: held 2.054s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['89b6c54f-ae04-4652-a757-9003e72c4286', '1779d59b-5933-48de-810a-169d28473d44', 'fff46ee7-6050-4f3b-a935-d5189705f8e8', 'ab5d6d6a-6e52-4d8a-a08d-20302986f627'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Delete snapshot completed successfully. Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-def59916-cf76-456e-b66a-d6924a5165cb-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Snapshots deleted, issuing volume delete {{(pid=87372) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" acquired by "delete_volume" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c9a158-b940-4d32-b7a0-1521b331194f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:19 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 Jul 21 08:13:19 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:20 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693" returned: 0 in 0.521s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:20 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693 Jul 21 08:13:20 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:20 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-63ed28dd-93cf-4b93-a767-e48f373e7693" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-63ed28dd-93cf-4b93-a767-e48f373e7693" released by "delete_volume" :: held 0.901s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['e9550059-4f74-479c-9800-79fee3231f97', '9db97c86-4f7d-415f-979d-d2e913d8f41a', '4b8ac2a2-ef7a-41cc-857c-913b70a9da37', '187bfa99-2c30-4c14-a479-d74a785a8ee6'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:20 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:20 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:20 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Deleted volume successfully. Jul 21 08:13:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f9e37115-8af4-4f70-b584-c671b8cd1ab6 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-63ed28dd-93cf-4b93-a767-e48f373e7693-delete_volume" released by "delete_volume" :: held 5.907s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (c79b74ff-6a37-4974-948d-2603e9544693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffba80a5-e2e6-4fea-a39a-f88bdf8c7c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffba80a5-e2e6-4fea-a39a-f88bdf8c7c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627378327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd86716e-2b4c-4cf3-9060-18fe250e2045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121ec02e37214d1da9427c279744b84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:22Z,use_quota=True,user_id='627f1b925adb42baae51882423a611ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de8ea51-819d-47f6-848c-9890d01ba27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de8ea51-819d-47f6-848c-9890d01ba27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109c0e5-d62f-4a47-9ec7-f9f84414f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109c0e5-d62f-4a47-9ec7-f9f84414f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd86716e-2b4c-4cf3-9060-18fe250e2045', 'volume_name': 'volume-fd86716e-2b4c-4cf3-9060-18fe250e2045', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56989e46-e389-462c-b375-26b8040d06e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56989e46-e389-462c-b375-26b8040d06e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea49999-992f-4381-bd62-619b02dfcc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:22 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Volume fd86716e-2b4c-4cf3-9060-18fe250e2045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd86716e-2b4c-4cf3-9060-18fe250e2045', 'volume_size': 1} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1627378327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd86716e-2b4c-4cf3-9060-18fe250e2045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121ec02e37214d1da9427c279744b84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:22Z,use_quota=True,user_id='627f1b925adb42baae51882423a611ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Creating volume fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:22 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:22 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 1073741824 Jul 21 08:13:22 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:23 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 1073741824" returned: 0 in 0.528s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:23 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:23 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:23 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.283s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea49999-992f-4381-bd62-619b02dfcc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd86716e-2b4c-4cf3-9060-18fe250e2045', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd795629-fe6e-4a31-be25-cafaef03fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Volume volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 (fd86716e-2b4c-4cf3-9060-18fe250e2045): created successfully Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd795629-fe6e-4a31-be25-cafaef03fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (c79b74ff-6a37-4974-948d-2603e9544693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-31e724f6-0f38-450f-838b-bc0e46001e25 tempest-VolumesDeleteCascade-626276688 None] Created volume successfully. Jul 21 08:13:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Creating offline snapshot f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 of volume fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:13:24 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7177d6-35c1-4cce-8769-7b22d3c6ef11]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:25 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:25 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:25 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.461s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:25 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 1G Jul 21 08:13:25 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:25 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 1G" returned: 0 in 0.569s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:25 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:25 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:26 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.360s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:26 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 is being set with open permissions: ugo+rw Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:26 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:26 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:26 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.292s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:26 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info Jul 21 08:13:26 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:26 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info" returned: 0 in 0.397s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:26 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info is being set with open permissions: ugo+rw Jul 21 08:13:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:27 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info Jul 21 08:13:27 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:27 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.info" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6b8b3038-7672-4101-bd93-a58a776fc2aa tempest-VolumesDeleteCascade-626276688 None] Create snapshot completed successfully Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (87900505-d2a1-4071-ab83-8805fa9fa918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b895b2-aacf-4159-8a56-2b7f2891407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b895b2-aacf-4159-8a56-2b7f2891407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-415145448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba2ce17-0e62-4149-9e57-0a641aa84456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='121ec02e37214d1da9427c279744b84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:29Z,use_quota=True,user_id='627f1b925adb42baae51882423a611ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74869766-ce8a-400c-9226-f9cc971a7353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74869766-ce8a-400c-9226-f9cc971a7353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbc20b1-43bf-43ac-9840-b1dcb3ebcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbc20b1-43bf-43ac-9840-b1dcb3ebcd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ba2ce17-0e62-4149-9e57-0a641aa84456', 'volume_name': 'volume-4ba2ce17-0e62-4149-9e57-0a641aa84456', 'volume_size': 1, 'snapshot_id': 'f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d20ea-619d-4cf3-ad94-de9358d3bf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295d20ea-619d-4cf3-ad94-de9358d3bf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311607d2-8a4a-41fa-993e-480c6ebad6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Volume 4ba2ce17-0e62-4149-9e57-0a641aa84456: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ba2ce17-0e62-4149-9e57-0a641aa84456', 'volume_size': 1, 'snapshot_id': 'f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6'} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-4ba2ce17-0e62-4149-9e57-0a641aa84456" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-4ba2ce17-0e62-4149-9e57-0a641aa84456" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Creating volume 4ba2ce17-0e62-4149-9e57-0a641aa84456 from snapshot f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] snapshot: f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6, volume: 4ba2ce17-0e62-4149-9e57-0a641aa84456, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbe94f-b290-4e4d-9a61-c57232d6a0c1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:29 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:29 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:29 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.415s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd86716e-2b4c-4cf3-9060-18fe250e2045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[33330739-a13e-485f-9e5c-b18b4cbd84bb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:29 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:29 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:30 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.684s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:30 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 Jul 21 08:13:30 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Flow 'volume_create_manager' (16dd1871-aac7-4bef-ac6d-58633347311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c9c4d8-f5a2-478c-8dc3-e3d01605cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c9c4d8-f5a2-478c-8dc3-e3d01605cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1733534275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68b9802-db0e-4c20-a794-806f1ec114a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f30b02d5154244e29de0eab63a944ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:30Z,use_quota=True,user_id='360d81858c5f4cabbd334192c5fcea82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dd4e42-c04c-43e0-a632-81d95aeeec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dd4e42-c04c-43e0-a632-81d95aeeec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9a6752-bbff-4b3c-b471-8da639c8a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9a6752-bbff-4b3c-b471-8da639c8a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68b9802-db0e-4c20-a794-806f1ec114a3', 'volume_name': 'volume-f68b9802-db0e-4c20-a794-806f1ec114a3', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fba65f-df0c-4878-82c4-c9722c3fc0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fba65f-df0c-4878-82c4-c9722c3fc0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be831db2-05e7-48db-81d0-2b22acfba688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:30 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Volume f68b9802-db0e-4c20-a794-806f1ec114a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68b9802-db0e-4c20-a794-806f1ec114a3', 'volume_size': 1} Jul 21 08:13:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Flow 'volume_create_manager' (569f02d9-d431-4895-a1a9-93365e0ed33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635190e6-fb7f-44fb-be56-cb180a4b3f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635190e6-fb7f-44fb-be56-cb180a4b3f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-833205545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b434c81f554ebc9089d05ae9b84ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:31Z,use_quota=True,user_id='95c82cfe21284f769232d4bb761f0992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b5cea5-55fb-4509-8761-0e815d72d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b5cea5-55fb-4509-8761-0e815d72d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875bbfe7-53a5-4427-ae7d-068c551be485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875bbfe7-53a5-4427-ae7d-068c551be485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b', 'volume_name': 'volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bb494b-cd53-48df-a38f-c13f03531a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84bb494b-cd53-48df-a38f-c13f03531a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97572eb0-c5e0-4c7a-917f-795fa67691ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:31 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Volume 1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b', 'volume_size': 1} Jul 21 08:13:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:36 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456" returned: 0 in 6.820s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc09c17-5fc3-458e-b165-9ddf6029dfd7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:37 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:37 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:37 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.589s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:13:37 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Converted 1024.00 MB image at 150.12 MB/s Jul 21 08:13:37 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 is being set with open permissions: ugo+rw Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:37 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 Jul 21 08:13:37 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:37 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" released by "_copy_volume_from_snapshot" :: held 8.909s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-4ba2ce17-0e62-4149-9e57-0a641aa84456" released by "_create_volume_from_snapshot" :: held 8.956s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.981s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.923s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1733534275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68b9802-db0e-4c20-a794-806f1ec114a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f30b02d5154244e29de0eab63a944ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:30Z,use_quota=True,user_id='360d81858c5f4cabbd334192c5fcea82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Creating volume f68b9802-db0e-4c20-a794-806f1ec114a3 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:37 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 1073741824 Jul 21 08:13:37 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311607d2-8a4a-41fa-993e-480c6ebad6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba2ce17-0e62-4149-9e57-0a641aa84456', 'volume_size': 1, 'snapshot_id': 'f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f12a95b-39ab-4a0f-abe3-30e9158cdaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Volume volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 (4ba2ce17-0e62-4149-9e57-0a641aa84456): created successfully Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f12a95b-39ab-4a0f-abe3-30e9158cdaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Flow 'volume_create_manager' (87900505-d2a1-4071-ab83-8805fa9fa918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7355e710-95b6-4bed-bb24-cb5df929a23b tempest-VolumesDeleteCascade-626276688 None] Created volume successfully. Jul 21 08:13:38 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 1073741824" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:38 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 Jul 21 08:13:38 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:38 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.206s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-833205545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b434c81f554ebc9089d05ae9b84ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:31Z,use_quota=True,user_id='95c82cfe21284f769232d4bb761f0992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Creating volume 1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:38 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be831db2-05e7-48db-81d0-2b22acfba688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68b9802-db0e-4c20-a794-806f1ec114a3', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:38 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b 1073741824 Jul 21 08:13:38 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f4556e-8e5c-4c3b-b8f0-ff8dce1fe538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Volume volume-f68b9802-db0e-4c20-a794-806f1ec114a3 (f68b9802-db0e-4c20-a794-806f1ec114a3): created successfully Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f4556e-8e5c-4c3b-b8f0-ff8dce1fe538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Flow 'volume_create_manager' (16dd1871-aac7-4bef-ac6d-58633347311c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-fcd8a08e-c33e-4f6d-a86a-2ea2804f9c84 req-ac409496-fbc7-459e-b0bc-475aea20c5bb tempest-VolumesGetTestJSON-744493772 None] Created volume successfully. Jul 21 08:13:39 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b 1073741824" returned: 0 in 0.457s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:39 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b Jul 21 08:13:39 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-fd86716e-2b4c-4cf3-9060-18fe250e2045-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-fd86716e-2b4c-4cf3-9060-18fe250e2045-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Performing cascade delete. {{(pid=87372) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Deleting offline snapshot f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 of volume fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] snapshot_file for this snap is: volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05fe8e-78ba-4a7e-9668-052dfd3fd386]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:39 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:39 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:39 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Acquiring lock "cinder-f68b9802-db0e-4c20-a794-806f1ec114a3-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97572eb0-c5e0-4c7a-917f-795fa67691ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa46c9f-ea92-4f4e-80bd-787d7e4a488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Volume volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b (1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b): created successfully Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa46c9f-ea92-4f4e-80bd-787d7e4a488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Flow 'volume_create_manager' (569f02d9-d431-4895-a1a9-93365e0ed33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "cinder-f68b9802-db0e-4c20-a794-806f1ec114a3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a241b5bf-6b4c-4078-bbb0-ccc8f20f8ca5 tempest-AttachVolumeShelveTestJSON-100776104 None] Created volume successfully. Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Acquiring lock "cinder-quobyte-f68b9802-db0e-4c20-a794-806f1ec114a3" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "cinder-quobyte-f68b9802-db0e-4c20-a794-806f1ec114a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2b1607-4434-4607-bbb4-4c82a2e75612]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:39 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 Jul 21 08:13:39 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:39 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.471s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd86716e-2b4c-4cf3-9060-18fe250e2045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f398ca-ab6f-4229-b1eb-ed4a8b5417f0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:40 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:40 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:40 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:40 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3 Jul 21 08:13:40 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:40 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.401s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:40 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:40 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:40 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f68b9802-db0e-4c20-a794-806f1ec114a3" returned: 0 in 0.306s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "cinder-quobyte-f68b9802-db0e-4c20-a794-806f1ec114a3" released by "delete_volume" :: held 0.744s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG cinder.quota [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Created reservations ['a7a11bb3-b05e-48f5-b1e0-41f434248362', 'a517eb4c-7fd7-4b7b-aa46-239b2e3aa43a', '46b157ba-43dc-4409-9ce1-ae56e2f61607', 'c3848502-01b0-4180-98f3-089dab970a52'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:40 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:40 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:40 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.503s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:40 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6 Jul 21 08:13:40 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:41 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.397s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.manager [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Deleted volume successfully. Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-10fb9f9b-a64e-4a82-a72c-12bdf257870f req-872ef5a0-55ff-483b-82e6-663533f0ac74 tempest-VolumesGetTestJSON-744493772 None] Lock "cinder-f68b9802-db0e-4c20-a794-806f1ec114a3-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:41 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045.f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" returned: 0 in 0.419s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6" released by "_delete_snapshot" :: held 1.919s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" released by "delete_snapshot" :: held 1.957s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['7933a006-de03-4bf0-9393-f730a3c35824', '29494158-2fbf-449a-8aa8-c9b96d0b5dc8', 'fa2980ce-9929-423b-9887-9419f678a2be', '9418523a-a41a-4781-874b-7f06d6f4b81e'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Delete snapshot completed successfully. Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-f231eb2d-f089-46d3-bdb7-b8f3b7ff5fe6-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Snapshots deleted, issuing volume delete {{(pid=87372) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5988097b-fb08-4381-ab50-20f3fdab11df]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:41 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:41 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:42 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.453s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:42 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045 Jul 21 08:13:42 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:42 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd86716e-2b4c-4cf3-9060-18fe250e2045" returned: 0 in 0.407s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-fd86716e-2b4c-4cf3-9060-18fe250e2045" released by "delete_volume" :: held 0.960s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['d685e411-5dfc-4d1e-94de-ff816451a352', 'e417cd92-9f0e-4055-9a2d-1946062f094e', 'decc1b32-5757-4071-86ea-771bc6f1fece', '0d87e28b-8efe-41ff-babe-61d357788070'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:42 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:42 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:43 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:43 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Deleted volume successfully. Jul 21 08:13:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c226fc7-9d66-4dd4-a188-0be61836c174 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-fd86716e-2b4c-4cf3-9060-18fe250e2045-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-4ba2ce17-0e62-4149-9e57-0a641aa84456-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-4ba2ce17-0e62-4149-9e57-0a641aa84456-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3086cd17-a45b-45f1-a576-d3414d8827a7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:44 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 Jul 21 08:13:44 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:44 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456" returned: 0 in 0.567s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:44 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456 Jul 21 08:13:44 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:44 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ba2ce17-0e62-4149-9e57-0a641aa84456" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-quobyte-4ba2ce17-0e62-4149-9e57-0a641aa84456" released by "delete_volume" :: held 0.940s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Created reservations ['2e91f598-ab96-4d4a-adc4-68fb6324a0a3', '8ea8f043-5bce-4179-9661-2cc605064caf', '3e4af632-8d75-4897-a56e-8ce773839ef2', '566eaa95-3927-4727-8cdd-0d0e42b7be08'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:45 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:45 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:45 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Deleted volume successfully. Jul 21 08:13:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fae00948-b0f2-45db-8195-650ea94c0b63 tempest-VolumesDeleteCascade-626276688 None] Lock "cinder-4ba2ce17-0e62-4149-9e57-0a641aa84456-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Flow 'volume_create_manager' (892f397a-837f-4934-a282-381529249171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccb49ad-0b47-4754-921b-5c47ebcb10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccb49ad-0b47-4754-921b-5c47ebcb10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1069833983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6314d0-7d66-4301-912d-61a635a149d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8669e2c1db84e75af30540aac9c962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:46Z,use_quota=True,user_id='662f4e51a9bf4b8eba71248e1283c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77521b37-a1dc-4e5b-838f-ee80e4b53a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77521b37-a1dc-4e5b-838f-ee80e4b53a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3108e295-9888-4999-89c1-6e53045e5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3108e295-9888-4999-89c1-6e53045e5513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6314d0-7d66-4301-912d-61a635a149d4', 'volume_name': 'volume-be6314d0-7d66-4301-912d-61a635a149d4', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41aa80a-ca15-4ea5-afb0-80d69b952aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41aa80a-ca15-4ea5-afb0-80d69b952aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7821535-3a52-486b-b40e-14c19e2d3c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:46 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Volume be6314d0-7d66-4301-912d-61a635a149d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6314d0-7d66-4301-912d-61a635a149d4', 'volume_size': 1} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1069833983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6314d0-7d66-4301-912d-61a635a149d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8669e2c1db84e75af30540aac9c962d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:46Z,use_quota=True,user_id='662f4e51a9bf4b8eba71248e1283c3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Creating volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:46 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:46 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 1073741824 Jul 21 08:13:46 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:47 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 1073741824" returned: 0 in 0.580s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:47 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 Jul 21 08:13:47 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:47 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4" returned: 0 in 0.306s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7821535-3a52-486b-b40e-14c19e2d3c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6314d0-7d66-4301-912d-61a635a149d4', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cf7955-cc98-465a-89b2-b26e8c79074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:47 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Volume volume-be6314d0-7d66-4301-912d-61a635a149d4 (be6314d0-7d66-4301-912d-61a635a149d4): created successfully Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cf7955-cc98-465a-89b2-b26e8c79074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Flow 'volume_create_manager' (892f397a-837f-4934-a282-381529249171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-55d742a7-ea99-4338-8130-e81084f64df6 tempest-SnapshotsActionsTest-1035096803 None] Created volume successfully. Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Flow 'volume_create_manager' (084348cf-e273-46a3-b124-b92d28965bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ea8f6a-fff2-481f-b6e2-5200d3a18e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ea8f6a-fff2-481f-b6e2-5200d3a18e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2043339669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69870028-f3f6-4948-8bcf-33f164ae1f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc1bd63fb244e7b99e1eb988a886674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:49Z,use_quota=True,user_id='d920613654ee4d428fba226f12f7d32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a64763-728d-4ec8-ab39-bada42050e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a64763-728d-4ec8-ab39-bada42050e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673c805-79c5-414a-9b27-68a0ccf37eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e673c805-79c5-414a-9b27-68a0ccf37eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69870028-f3f6-4948-8bcf-33f164ae1f39', 'volume_name': 'volume-69870028-f3f6-4948-8bcf-33f164ae1f39', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7b509-8017-4fc5-aa8f-0b9e890b56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7b509-8017-4fc5-aa8f-0b9e890b56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc570586-c10c-461d-aacc-c8e525deceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Volume 69870028-f3f6-4948-8bcf-33f164ae1f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69870028-f3f6-4948-8bcf-33f164ae1f39', 'volume_size': 1} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2043339669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69870028-f3f6-4948-8bcf-33f164ae1f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc1bd63fb244e7b99e1eb988a886674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:49Z,use_quota=True,user_id='d920613654ee4d428fba226f12f7d32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Creating volume 69870028-f3f6-4948-8bcf-33f164ae1f39 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:49 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:49 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 1073741824 Jul 21 08:13:49 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:49 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 1073741824" returned: 0 in 0.481s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:49 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 Jul 21 08:13:49 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:49 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.716s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc570586-c10c-461d-aacc-c8e525deceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69870028-f3f6-4948-8bcf-33f164ae1f39', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f085d812-b516-4518-89e0-80a6f0f245af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Creating offline snapshot 1aed394f-ccf8-4dbb-80e0-b758f9ceca93 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:13:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Volume volume-69870028-f3f6-4948-8bcf-33f164ae1f39 (69870028-f3f6-4948-8bcf-33f164ae1f39): created successfully Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f085d812-b516-4518-89e0-80a6f0f245af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Flow 'volume_create_manager' (084348cf-e273-46a3-b124-b92d28965bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e056b92d-0160-4dc8-8598-a937afc7a984]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a9bd20f6-7f5c-43e1-8f63-6d306622e815 tempest-VolumesMetadataTest-2107358645 None] Created volume successfully. Jul 21 08:13:49 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 Jul 21 08:13:49 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:50 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:50 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 1G Jul 21 08:13:50 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:50 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 1G" returned: 0 in 0.436s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:50 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:13:50 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:50 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:50 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 is being set with open permissions: ugo+rw Jul 21 08:13:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:51 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:13:51 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-329f798e-9e6e-4e6e-addb-b4db3b3f11ff req-2337c44e-4261-475c-ad3c-1b13f9ef551e tempest-AttachVolumeShelveTestJSON-100776104 None] No connector for attachment 361f06d4-db3e-49f2-86ea-1fdba87fbaa8; skipping storage backend terminate_connection call. {{(pid=87372) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-329f798e-9e6e-4e6e-addb-b4db3b3f11ff req-2337c44e-4261-475c-ad3c-1b13f9ef551e tempest-AttachVolumeShelveTestJSON-100776104 None] Deleting attachment 361f06d4-db3e-49f2-86ea-1fdba87fbaa8. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:13:51 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:51 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info Jul 21 08:13:51 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Acquiring lock "cinder-69870028-f3f6-4948-8bcf-33f164ae1f39-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "cinder-69870028-f3f6-4948-8bcf-33f164ae1f39-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:51 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info" returned: 0 in 0.346s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:51 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info is being set with open permissions: ugo+rw Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:51 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info Jul 21 08:13:51 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Acquiring lock "cinder-quobyte-69870028-f3f6-4948-8bcf-33f164ae1f39" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "cinder-quobyte-69870028-f3f6-4948-8bcf-33f164ae1f39" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[059e75d2-28b9-4e58-a840-ca5c027c35a0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:52 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 Jul 21 08:13:52 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:52 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.info" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bdd14255-5c08-4e31-95ea-cf52581d1957 tempest-SnapshotsActionsTest-1035096803 None] Create snapshot completed successfully Jul 21 08:13:52 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:52 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39 Jul 21 08:13:52 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:52 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69870028-f3f6-4948-8bcf-33f164ae1f39" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "cinder-quobyte-69870028-f3f6-4948-8bcf-33f164ae1f39" released by "delete_volume" :: held 0.731s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:52 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:52 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Created reservations ['ee2a4386-5af9-48cc-9e06-3f7d70f61ba0', '0b8b9c6d-56cd-424f-ac71-dfee2d98ba3d', '116da177-28fc-463a-8e0d-5213236f86d5', 'dd6d22a0-0b7c-4314-b9aa-343fbfd409ba'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:52 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:13:52 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:52 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 8 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:13:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:13:53 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:13:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Deleted volume successfully. Jul 21 08:13:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c5c17b20-8845-4cbc-b530-c0d3572ce5fe tempest-VolumesMetadataTest-2107358645 None] Lock "cinder-69870028-f3f6-4948-8bcf-33f164ae1f39-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Creating offline snapshot 41333883-0bce-4d10-bd1f-798858edd02c of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca1a6c-db44-4ea3-8df2-1f416249fcc1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:54 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:13:54 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:54 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.416s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:54 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c 1G Jul 21 08:13:54 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:55 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c 1G" returned: 0 in 0.606s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:55 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c Jul 21 08:13:55 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:55 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c" returned: 0 in 0.322s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:55 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c is being set with open permissions: ugo+rw Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:55 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c Jul 21 08:13:55 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:55 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c8a1a555-7a3d-40a2-9aa6-f0ee5eeb9711 tempest-SnapshotsActionsTest-1035096803 None] Create snapshot completed successfully Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-41333883-0bce-4d10-bd1f-798858edd02c-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-41333883-0bce-4d10-bd1f-798858edd02c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-41333883-0bce-4d10-bd1f-798858edd02c" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-41333883-0bce-4d10-bd1f-798858edd02c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Deleting offline snapshot 41333883-0bce-4d10-bd1f-798858edd02c of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] snapshot_file for this snap is: volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d22d8a-3fe2-4b2c-b8c8-2886e917f123]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:56 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c Jul 21 08:13:56 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:57 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c" returned: 0 in 0.444s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[339546b2-5f45-4ea0-a758-24cee4ca789b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:57 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:13:57 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:57 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.535s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:13:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:57 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c Jul 21 08:13:57 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (109c8c7c-5e55-4722-b718-1fc9719363cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2222446-e474-43a6-9742-ebbffba32c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2222446-e474-43a6-9742-ebbffba32c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1885961544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca08d57-ae19-4422-9e53-aa40bce475da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:58Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a1a2e1-800e-4218-90e9-31103cbf3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a1a2e1-800e-4218-90e9-31103cbf3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f827f83-f8ef-4759-9f50-bf28d0f6d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f827f83-f8ef-4759-9f50-bf28d0f6d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca08d57-ae19-4422-9e53-aa40bce475da', 'volume_name': 'volume-eca08d57-ae19-4422-9e53-aa40bce475da', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70191ae4-f061-49d3-9b2e-878c670d1d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70191ae4-f061-49d3-9b2e-878c670d1d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30570286-bf86-4e10-8f85-130d682dcb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Volume eca08d57-ae19-4422-9e53-aa40bce475da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca08d57-ae19-4422-9e53-aa40bce475da', 'volume_size': 1} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1885961544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca08d57-ae19-4422-9e53-aa40bce475da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:13:58Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Creating volume eca08d57-ae19-4422-9e53-aa40bce475da {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:13:58 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:58 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da 1073741824 Jul 21 08:13:58 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:58 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:58 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c Jul 21 08:13:58 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:58 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.41333883-0bce-4d10-bd1f-798858edd02c" returned: 0 in 0.312s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-41333883-0bce-4d10-bd1f-798858edd02c" released by "_delete_snapshot" :: held 1.995s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_snapshot" :: held 2.030s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:58 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da 1073741824" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Created reservations ['843b8b7b-6254-4ddf-8ac8-497deeda5ba2', '54cd606a-51e1-411d-9d2f-46cd8f504ec2', '6167d3e7-8712-4955-a07c-a6def8749e2a', 'ffb3812f-2d94-442c-9b49-3e6f3928d8a9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:13:58 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da Jul 21 08:13:58 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:13:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Delete snapshot completed successfully. Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4b9b547f-46f2-42d8-91d6-05fdb92b12aa tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-41333883-0bce-4d10-bd1f-798858edd02c-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:13:58 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da" returned: 0 in 0.282s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30570286-bf86-4e10-8f85-130d682dcb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca08d57-ae19-4422-9e53-aa40bce475da', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b451da-ea63-4a76-a177-12ace7fe38f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:13:58 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Volume volume-eca08d57-ae19-4422-9e53-aa40bce475da (eca08d57-ae19-4422-9e53-aa40bce475da): created successfully Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b451da-ea63-4a76-a177-12ace7fe38f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:13:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (109c8c7c-5e55-4722-b718-1fc9719363cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:13:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-66b12d88-ea81-45a6-aafd-b25d457383df tempest-AttachVolumeNegativeTest-1805662753 None] Created volume successfully. Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Creating offline snapshot b980d381-70ca-4fce-bfe7-84ebed92bb4e of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[466ad23f-9201-4ea2-b367-1d67d6f531e7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:00 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:00 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:00 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.540s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:00 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e 1G Jul 21 08:14:00 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6f953d5c-6f45-4a2c-a147-d196002f7da5 req-a60be276-0281-48eb-9d9b-88829a846806 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:01 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e 1G" returned: 0 in 0.798s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:01 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e Jul 21 08:14:01 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:02 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:02 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e is being set with open permissions: ugo+rw Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:02 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e Jul 21 08:14:02 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:02 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6f953d5c-6f45-4a2c-a147-d196002f7da5 req-a60be276-0281-48eb-9d9b-88829a846806 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.217s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6f953d5c-6f45-4a2c-a147-d196002f7da5 req-a60be276-0281-48eb-9d9b-88829a846806 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0d7051a7-350c-4105-8a1b-13bfe4bd768d tempest-SnapshotsActionsTest-1035096803 None] Create snapshot completed successfully Jul 21 08:14:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-6f953d5c-6f45-4a2c-a147-d196002f7da5 req-a60be276-0281-48eb-9d9b-88829a846806 tempest-AttachVolumeNegativeTest-1805662753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-eca08d57-ae19-4422-9e53-aa40bce475da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09f44d6a-8656-4859-a227-3b3ed71ca4d3', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:14:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-6f953d5c-6f45-4a2c-a147-d196002f7da5 req-a60be276-0281-48eb-9d9b-88829a846806 tempest-AttachVolumeNegativeTest-1805662753 None] attachment_update completed successfully. Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-b980d381-70ca-4fce-bfe7-84ebed92bb4e-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-b980d381-70ca-4fce-bfe7-84ebed92bb4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-b980d381-70ca-4fce-bfe7-84ebed92bb4e" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-b980d381-70ca-4fce-bfe7-84ebed92bb4e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Deleting offline snapshot b980d381-70ca-4fce-bfe7-84ebed92bb4e of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] snapshot_file for this snap is: volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb3a0f-5b21-4050-b3b1-32b6f3af4a47]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:04 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e Jul 21 08:14:04 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:04 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e" returned: 0 in 0.726s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:04 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0b914-10bd-44ec-821b-64e66be0cb84]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:04 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:04 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:05 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.794s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:05 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:05 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e Jul 21 08:14:05 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=105,cinder:UPDATE=115,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=117,cinder:SELECT=102,cinder:INSERT=30,cinder:DELETE=12 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:14:06 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-ba2f9577-0380-4e5d-b9cf-9bd1624bc043 req-78a85fe6-394d-4774-8a4c-e1c514bacad1 tempest-AttachVolumeNegativeTest-1805662753 None] Terminate volume connection completed successfully. Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-ba2f9577-0380-4e5d-b9cf-9bd1624bc043 req-78a85fe6-394d-4774-8a4c-e1c514bacad1 tempest-AttachVolumeNegativeTest-1805662753 None] Deleting attachment 09f44d6a-8656-4859-a227-3b3ed71ca4d3. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:14:06 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e" returned: 0 in 0.895s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:06 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e Jul 21 08:14:06 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:06 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.b980d381-70ca-4fce-bfe7-84ebed92bb4e" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-b980d381-70ca-4fce-bfe7-84ebed92bb4e" released by "_delete_snapshot" :: held 2.984s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_snapshot" :: held 3.042s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:06 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Created reservations ['cd9572d2-9a9a-4527-bed5-9e540337c094', '7a77c77e-e0be-419c-bbf1-f75658fa03bf', '3471cc66-882b-49c0-8bbb-6650276224d3', 'd1610290-3287-43a6-b77c-4a3f150d0f1a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Delete snapshot completed successfully. Jul 21 08:14:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-191f634d-0cd8-4c49-a8c2-a12360f6cf7f tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-b980d381-70ca-4fce-bfe7-84ebed92bb4e-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Creating offline snapshot 957e5728-3453-43c2-a328-330e5aa76ee8 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:14:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aef605-1453-40ec-aecd-40553d26a84e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:08 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:08 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:09 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.728s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:09 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 1G Jul 21 08:14:09 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:10 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 1G" returned: 0 in 0.854s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:10 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 Jul 21 08:14:10 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:11 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8" returned: 0 in 0.788s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:11 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 is being set with open permissions: ugo+rw Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:11 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 Jul 21 08:14:11 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Flow 'volume_create_manager' (63ab55df-2209-4f99-870a-0ce0af9e4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c93841-007a-41fd-8b95-b0b5479f784b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c93841-007a-41fd-8b95-b0b5479f784b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084194325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b0188c571486d88b499eda0343c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:11Z,use_quota=True,user_id='0730f2611f0246f49060033bb50830a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2520be17-df6b-490b-ae08-71cf5bdf8a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2520be17-df6b-490b-ae08-71cf5bdf8a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837aa699-4409-4ad8-b0ee-379a58f94811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837aa699-4409-4ad8-b0ee-379a58f94811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76', 'volume_name': 'volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54ad51e-3565-4fb5-a588-708771661ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54ad51e-3565-4fb5-a588-708771661ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbec5e94-3489-41ae-b853-c1af41fdf852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76', 'volume_size': 1} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:11 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8" returned: 0 in 0.450s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.250s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1084194325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93b0188c571486d88b499eda0343c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:11Z,use_quota=True,user_id='0730f2611f0246f49060033bb50830a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Creating volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:14:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7ac3ae2b-ae9b-488b-bd09-355e8d4e2708 tempest-SnapshotsActionsTest-1035096803 None] Create snapshot completed successfully Jul 21 08:14:11 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 1073741824 Jul 21 08:14:11 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-957e5728-3453-43c2-a328-330e5aa76ee8-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-957e5728-3453-43c2-a328-330e5aa76ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-957e5728-3453-43c2-a328-330e5aa76ee8" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-957e5728-3453-43c2-a328-330e5aa76ee8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Deleting offline snapshot 957e5728-3453-43c2-a328-330e5aa76ee8 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] snapshot_file for this snap is: volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc650bc0-570c-4bfc-a153-0801777c2d0d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:12 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 Jul 21 08:14:12 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:12 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 1073741824" returned: 0 in 0.630s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:12 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:14:12 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:12 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8" returned: 0 in 0.483s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:12 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.312s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[63886e71-8ea5-424d-9a8b-8c41c9a9a72f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbec5e94-3489-41ae-b853-c1af41fdf852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ca87f3-5fd2-4639-8c89-6fd7c9d41d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Volume volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 (b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76): created successfully Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ca87f3-5fd2-4639-8c89-6fd7c9d41d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Flow 'volume_create_manager' (63ab55df-2209-4f99-870a-0ce0af9e4c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:14:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01b1521c-6ffa-4fc0-b1f9-1ee383358b2e tempest-VolumesActionsTest-1816501321 None] Created volume successfully. Jul 21 08:14:12 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:12 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:12 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:13 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 Jul 21 08:14:13 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:13 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8" returned: 0 in 0.506s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:13 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8 Jul 21 08:14:13 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:13 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.957e5728-3453-43c2-a328-330e5aa76ee8" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-957e5728-3453-43c2-a328-330e5aa76ee8" released by "_delete_snapshot" :: held 2.011s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_snapshot" :: held 2.044s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:14 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Created reservations ['e3514172-fc37-4742-96e2-edf126351830', 'f0ddc959-4c0f-4e6d-a31d-c947b3a880b1', '0bcd483f-b820-43bf-ab53-6c0c55467c04', '86ab88df-cff4-4c60-8d5a-c6e3bd052dc5'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Delete snapshot completed successfully. Jul 21 08:14:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8969d023-397d-4b00-bd74-b8e2b28f451a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-957e5728-3453-43c2-a328-330e5aa76ee8-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Creating offline snapshot 013e690d-afd1-4c5e-8615-5ce641cc0368 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:14:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97b04e-628c-4091-9eb6-9e16d0f81c5e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:15 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:15 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:16 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:16 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 1G Jul 21 08:14:16 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:16 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 1G" returned: 0 in 0.588s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:16 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 Jul 21 08:14:16 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:17 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368" returned: 0 in 0.567s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:17 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 is being set with open permissions: ugo+rw Jul 21 08:14:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:17 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 Jul 21 08:14:17 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:17 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-77ee5738-5771-4878-b4a7-57f425440f07 tempest-SnapshotsActionsTest-1035096803 None] Create snapshot completed successfully Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-013e690d-afd1-4c5e-8615-5ce641cc0368-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-013e690d-afd1-4c5e-8615-5ce641cc0368-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Acquiring lock "cinder-quobyte-013e690d-afd1-4c5e-8615-5ce641cc0368" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-013e690d-afd1-4c5e-8615-5ce641cc0368" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Deleting offline snapshot 013e690d-afd1-4c5e-8615-5ce641cc0368 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:14:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] snapshot_file for this snap is: volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2865fd0-493a-4fb5-962f-5c8625797f28]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:19 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 Jul 21 08:14:19 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:19 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368" returned: 0 in 0.742s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffbf149-9a52-4fae-9955-5fb901faa957]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:20 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:20 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:20 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.746s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:20 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 Jul 21 08:14:20 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:21 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368" returned: 0 in 0.513s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:21 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368 Jul 21 08:14:21 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:21 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.013e690d-afd1-4c5e-8615-5ce641cc0368" returned: 0 in 0.634s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-013e690d-afd1-4c5e-8615-5ce641cc0368" released by "_delete_snapshot" :: held 2.817s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_snapshot" :: held 2.848s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Created reservations ['f9f4c1cb-d992-4483-a5b1-4697142d2b10', 'f4669aa9-7978-4c7c-912a-1c6cd735d4c8', 'bc6636e2-5c88-4bf4-840d-51136fc5b943', 'fd5e31fb-5632-4299-b9e1-317ea65ef59a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Delete snapshot completed successfully. Jul 21 08:14:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9eee85a-fada-40f2-83d0-ca6cbfa7a12a tempest-SnapshotsActionsTest-981537179 None] Lock "cinder-013e690d-afd1-4c5e-8615-5ce641cc0368-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "cinder-1aed394f-ccf8-4dbb-80e0-b758f9ceca93-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-1aed394f-ccf8-4dbb-80e0-b758f9ceca93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "cinder-quobyte-1aed394f-ccf8-4dbb-80e0-b758f9ceca93" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-1aed394f-ccf8-4dbb-80e0-b758f9ceca93" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Deleting offline snapshot 1aed394f-ccf8-4dbb-80e0-b758f9ceca93 of volume be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] snapshot_file for this snap is: volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e89a79-e523-4c6e-a2c2-f5d4a33d225c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:23 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:23 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67c7f760-c046-4be3-b995-a39bb05dccd0 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" by "attach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67c7f760-c046-4be3-b995-a39bb05dccd0 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" acquired by "attach_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-67c7f760-c046-4be3-b995-a39bb05dccd0 tempest-VolumesActionsTest-1816501321 None] Attaching volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 to instance 2565e2f1-4161-4614-ad36-a1b034cfef2d at mountpoint /dev/vdb on host None. Jul 21 08:14:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-67c7f760-c046-4be3-b995-a39bb05dccd0 tempest-VolumesActionsTest-1816501321 None] Attach volume completed successfully. Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67c7f760-c046-4be3-b995-a39bb05dccd0 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" released by "attach_volume" :: held 0.344s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:24 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 1.129s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be6314d0-7d66-4301-912d-61a635a149d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8933d5-4479-4a68-87e4-44e0c2a1be5f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-588d0edd-9538-4529-ad24-d0dcbc447b6b tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" by "detach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-588d0edd-9538-4529-ad24-d0dcbc447b6b tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-588d0edd-9538-4529-ad24-d0dcbc447b6b tempest-VolumesActionsTest-1816501321 None] Detaching volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 from instance 2565e2f1-4161-4614-ad36-a1b034cfef2d. Jul 21 08:14:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-588d0edd-9538-4529-ad24-d0dcbc447b6b tempest-VolumesActionsTest-1816501321 None] Detach volume completed successfully. Jul 21 08:14:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-588d0edd-9538-4529-ad24-d0dcbc447b6b tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" released by "detach_volume" :: held 0.256s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:25 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 Jul 21 08:14:25 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:25 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4" returned: 0 in 1.064s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:25 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:25 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:26 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.742s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:26 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93 Jul 21 08:14:26 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:27 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4.1aed394f-ccf8-4dbb-80e0-b758f9ceca93" returned: 0 in 0.742s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-1aed394f-ccf8-4dbb-80e0-b758f9ceca93" released by "_delete_snapshot" :: held 3.968s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_snapshot" :: held 4.006s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:27 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Created reservations ['5f3bb52d-f482-4eeb-815f-8fdbfa47f0c4', 'a0cbe201-f0df-494c-8410-f3c714de79b8', '33106cf3-95cb-496a-8132-79d3c6a02507', 'fc887c54-47cc-4790-9238-d2dee8301f98'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Delete snapshot completed successfully. Jul 21 08:14:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e913574c-20cb-4c90-a672-ec803f938642 tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-1aed394f-ccf8-4dbb-80e0-b758f9ceca93-delete_snapshot" released by "delete_snapshot" :: held 4.358s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "cinder-be6314d0-7d66-4301-912d-61a635a149d4-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-be6314d0-7d66-4301-912d-61a635a149d4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" acquired by "delete_volume" :: waited 0.061s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[52120164-16d2-4eb4-ae23-45a738b41167]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:28 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 Jul 21 08:14:28 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:29 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4" returned: 0 in 0.833s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:29 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4 Jul 21 08:14:29 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:29 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-be6314d0-7d66-4301-912d-61a635a149d4" returned: 0 in 0.519s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-quobyte-be6314d0-7d66-4301-912d-61a635a149d4" released by "delete_volume" :: held 1.477s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Created reservations ['9946553a-4260-46af-8262-c09e8b3a8f7b', '4294eb47-3992-4767-a65f-9d3b33c159c2', '85b5f3f1-5560-4cc4-bf58-1e836acb9830', '070988ee-94e0-4ab6-82be-015b3cc9b602'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:14:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:30 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:14:30 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:30 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.483s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:30 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:14:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Deleted volume successfully. Jul 21 08:14:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d196b691-f39a-4f48-9a38-81d52051104e tempest-SnapshotsActionsTest-1035096803 None] Lock "cinder-be6314d0-7d66-4301-912d-61a635a149d4-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Acquiring lock "cinder-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "cinder-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Acquiring lock "cinder-quobyte-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "cinder-quobyte-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb093eaa-949a-4ba5-83dd-9d73327b1d0c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:32 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b Jul 21 08:14:32 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:32 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:32 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b Jul 21 08:14:32 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:33 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" returned: 0 in 0.350s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "cinder-quobyte-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b" released by "delete_volume" :: held 0.963s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Created reservations ['a2ad87da-38f6-4cff-b064-1d32938dab68', 'ef6417fc-c651-4663-83d8-cf64b18946cd', '13e9681f-1c27-4afd-8e72-e3ec69f7582f', 'addf097a-f25c-420d-bf79-6ca3af084cb7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:33 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:14:33 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:33 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.361s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:14:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Deleted volume successfully. Jul 21 08:14:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cae9e30c-04ba-42e2-97fd-695cbb74dab8 tempest-AttachVolumeShelveTestJSON-100776104 None] Lock "cinder-1ca7fd2b-2f0a-4366-bb6d-9a83aa30a12b-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-15fca8f0-f5a9-4705-ab88-85852010912b tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" by "attach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-15fca8f0-f5a9-4705-ab88-85852010912b tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" acquired by "attach_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-15fca8f0-f5a9-4705-ab88-85852010912b tempest-VolumesActionsTest-1816501321 None] Attaching volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 to instance 46d95833-af4a-4a91-8562-c8ad02c400b2 at mountpoint /dev/vdb on host None. Jul 21 08:14:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-15fca8f0-f5a9-4705-ab88-85852010912b tempest-VolumesActionsTest-1816501321 None] Attach volume completed successfully. Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-15fca8f0-f5a9-4705-ab88-85852010912b tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" released by "attach_volume" :: held 0.134s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ade79a2d-ed6c-47a7-96c7-36b2492d0411 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" by "detach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ade79a2d-ed6c-47a7-96c7-36b2492d0411 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:14:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ade79a2d-ed6c-47a7-96c7-36b2492d0411 tempest-VolumesActionsTest-1816501321 None] Detaching volume b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 from instance 46d95833-af4a-4a91-8562-c8ad02c400b2. Jul 21 08:14:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ade79a2d-ed6c-47a7-96c7-36b2492d0411 tempest-VolumesActionsTest-1816501321 None] Detach volume completed successfully. Jul 21 08:14:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ade79a2d-ed6c-47a7-96c7-36b2492d0411 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df901c-cd79-4895-8f70-f4d75dd8c3c8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:48 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:14:48 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:48 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[146882bd-3fc0-4481-8352-70b1723bb291]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:48 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:14:48 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:48 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.5344e6f7-5266-4389-872b-d85b6c81e53f4s534izi.img {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:48 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.5344e6f7-5266-4389-872b-d85b6c81e53f4s534izi.img Jul 21 08:14:48 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (9e300a38-7578-4778-866a-9f1b9ca4fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc875240-4ed9-41e5-be35-1fcc387e602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc875240-4ed9-41e5-be35-1fcc387e602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1739790989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910b143-7eab-410e-bcd8-523c6d827f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:52Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9272440-6682-43b6-8601-f651e8b878f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9272440-6682-43b6-8601-f651e8b878f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba5290-0c73-4087-a336-365fc6515c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ba5290-0c73-4087-a336-365fc6515c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4910b143-7eab-410e-bcd8-523c6d827f85', 'volume_name': 'volume-4910b143-7eab-410e-bcd8-523c6d827f85', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a777a4-bd38-4f83-88cc-ce4f57145d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a777a4-bd38-4f83-88cc-ce4f57145d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f677550-15b5-496b-aa4f-d41ac720da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:52 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Volume 4910b143-7eab-410e-bcd8-523c6d827f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4910b143-7eab-410e-bcd8-523c6d827f85', 'volume_size': 1} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:14:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:52 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:14:52 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:53 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.663s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 8 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (471fc22b-764a-45b3-9192-2ad1eb8745ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e14655-014d-41da-af12-2b9951bfd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e14655-014d-41da-af12-2b9951bfd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-816512609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ac2d4-1ca4-432b-a7f4-71b0c307a931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:54Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb57fd8-adc8-4a9c-93b6-0c515a15e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb57fd8-adc8-4a9c-93b6-0c515a15e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d2ad23-bb08-4044-85ad-c746ea660513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d2ad23-bb08-4044-85ad-c746ea660513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15ac2d4-1ca4-432b-a7f4-71b0c307a931', 'volume_name': 'volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f916592e-3271-4847-83c4-7fe05746fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f916592e-3271-4847-83c4-7fe05746fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e11fa39-5953-4470-94e6-0fe4851cc687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:14:53 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Volume d15ac2d4-1ca4-432b-a7f4-71b0c307a931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931', 'volume_size': 1} Jul 21 08:14:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:14:54 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.5344e6f7-5266-4389-872b-d85b6c81e53f4s534izi.img" returned: 0 in 6.000s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4640406c-537a-4897-bc2d-feefdccafee4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:14:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:14:55 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:14:55 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:14:55 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 21 08:14:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.537s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:14:55 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.5344e6f7-5266-4389-872b-d85b6c81e53f4s534izi.img {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:14:55 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Converted 1024.00 MB image at 170.64 MB/s Jul 21 08:14:55 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] 5344e6f7-5266-4389-872b-d85b6c81e53f was raw, no need to convert to raw {{(pid=87372) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 21 08:15:03 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=58,cinder:INSERT=13,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:15:05 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=48,cinder:INSERT=16,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.119s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Uploaded volume to glance image-id: 5344e6f7-5266-4389-872b-d85b6c81e53f. {{(pid=87372) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.677s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1739790989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4910b143-7eab-410e-bcd8-523c6d827f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32bf21706e234bf1a8e1327cdebef6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:52Z,use_quota=True,user_id='61249131966f4582b2cd15382a000279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Creating volume 4910b143-7eab-410e-bcd8-523c6d827f85 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:18 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 1073741824 Jul 21 08:15:18 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-82b238c1-c56f-446f-b64b-db9d49a8a343 tempest-VolumesActionsTest-1816501321 None] Copy volume to image completed successfully. Jul 21 08:15:18 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 1073741824" returned: 0 in 0.441s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:18 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 Jul 21 08:15:18 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:18 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.099s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-816512609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ac2d4-1ca4-432b-a7f4-71b0c307a931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:14:54Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Creating volume d15ac2d4-1ca4-432b-a7f4-71b0c307a931 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:18 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 1073741824 Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f677550-15b5-496b-aa4f-d41ac720da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4910b143-7eab-410e-bcd8-523c6d827f85', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:18 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1605b-d42e-43c0-97eb-ad9d9e743231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Volume volume-4910b143-7eab-410e-bcd8-523c6d827f85 (4910b143-7eab-410e-bcd8-523c6d827f85): created successfully Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d1605b-d42e-43c0-97eb-ad9d9e743231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Flow 'volume_create_manager' (9e300a38-7578-4778-866a-9f1b9ca4fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-833b6ba1-c9e6-4ea3-bb43-4068999b5056 tempest-AttachVolumeNegativeTest-1805662753 None] Created volume successfully. Jul 21 08:15:19 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 1073741824" returned: 0 in 0.590s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:19 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 Jul 21 08:15:19 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:19 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.210s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e11fa39-5953-4470-94e6-0fe4851cc687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cb89c4-0cfa-49f6-bfbc-8a9ad4ad090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[46935b70-4c34-427f-8552-f78d9d59a60f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Volume volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 (d15ac2d4-1ca4-432b-a7f4-71b0c307a931): created successfully Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cb89c4-0cfa-49f6-bfbc-8a9ad4ad090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (471fc22b-764a-45b3-9192-2ad1eb8745ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2fa100dc-0e94-4ed8-a533-dbf00b8aba92 tempest-VolumesListAdminTestJSON-1204649371 None] Created volume successfully. Jul 21 08:15:20 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:15:20 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-29071351-4645-49f0-af1c-dce8d1bb8b9d req-0754d0fc-3b2d-454e-97f4-b993a9c62d75 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:20 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031de7b-2ef0-4f7c-b52b-e5754616d3a6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:20 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:15:20 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:20 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.388s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:20 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img Jul 21 08:15:20 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (ab537f86-e903-4b80-b468-d6bc2200c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66b808f-1e8d-4d7c-a1ef-f660dc4e17c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66b808f-1e8d-4d7c-a1ef-f660dc4e17c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-428237539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260a6647-bb3a-480f-a45b-e44460b1ba19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:21Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b96057-a489-488f-847a-0e0ffb94fd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b96057-a489-488f-847a-0e0ffb94fd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e402bab-fcbd-431b-afea-cfa239dbb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e402bab-fcbd-431b-afea-cfa239dbb73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260a6647-bb3a-480f-a45b-e44460b1ba19', 'volume_name': 'volume-260a6647-bb3a-480f-a45b-e44460b1ba19', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6e27c-d021-46a4-b8fb-df06f7b06c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6e27c-d021-46a4-b8fb-df06f7b06c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31287ba-c0e0-438b-a6c6-49ae48cb96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Volume 260a6647-bb3a-480f-a45b-e44460b1ba19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260a6647-bb3a-480f-a45b-e44460b1ba19', 'volume_size': 1} Jul 21 08:15:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:24 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img" returned: 0 in 4.040s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:24 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ec781-96b1-4f32-8b60-29476f541c53]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:24 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:15:24 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:25 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.516s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:15:25 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Converted 1024.00 MB image at 253.42 MB/s Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] f9e4771c-51ff-448c-8102-169d2f2342d9 was raw, converting to qcow2 {{(pid=87372) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c42173-5712-4340-886f-d6fb39473c88]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:25 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img Jul 21 08:15:25 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:25 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img" returned: 0 in 0.337s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:25 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img Jul 21 08:15:25 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:26 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img" returned: 1 in 0.320s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img /opt/stack/data/cinder/conversion/vol_upload_uz6csl25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:26 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img /opt/stack/data/cinder/conversion/vol_upload_uz6csl25 Jul 21 08:15:26 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:26 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img /opt/stack/data/cinder/conversion/vol_upload_uz6csl25" returned: 0 in 0.248s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Image conversion details: src /opt/stack/data/cinder/conversion/b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76.temp_image.f9e4771c-51ff-448c-8102-169d2f2342d95ryj_ph3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_uz6csl25 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:15:26 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e0127-8aaf-4a5b-9420-ceb65a111b9b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uz6csl25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:26 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uz6csl25 Jul 21 08:15:26 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:26 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uz6csl25" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.111s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Uploaded volume to glance image-id: f9e4771c-51ff-448c-8102-169d2f2342d9. {{(pid=87372) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-29071351-4645-49f0-af1c-dce8d1bb8b9d req-0754d0fc-3b2d-454e-97f4-b993a9c62d75 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.787s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-29071351-4645-49f0-af1c-dce8d1bb8b9d req-0754d0fc-3b2d-454e-97f4-b993a9c62d75 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.021s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-428237539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260a6647-bb3a-480f-a45b-e44460b1ba19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:21Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Creating volume 260a6647-bb3a-480f-a45b-e44460b1ba19 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:28 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2fc2ca3b-3d68-4f93-ad6f-cc38c63d637c tempest-VolumesActionsTest-1816501321 None] Copy volume to image completed successfully. Jul 21 08:15:28 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 1073741824 Jul 21 08:15:28 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-29071351-4645-49f0-af1c-dce8d1bb8b9d req-0754d0fc-3b2d-454e-97f4-b993a9c62d75 tempest-AttachVolumeNegativeTest-1805662753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-4910b143-7eab-410e-bcd8-523c6d827f85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1d77015-6f86-485c-9205-ed9d5136cc79', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:15:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-29071351-4645-49f0-af1c-dce8d1bb8b9d req-0754d0fc-3b2d-454e-97f4-b993a9c62d75 tempest-AttachVolumeNegativeTest-1805662753 None] attachment_update completed successfully. Jul 21 08:15:28 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 1073741824" returned: 0 in 0.514s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:28 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 Jul 21 08:15:28 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:28 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19" returned: 0 in 0.320s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31287ba-c0e0-438b-a6c6-49ae48cb96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260a6647-bb3a-480f-a45b-e44460b1ba19', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f848b8-fb6a-4554-b800-473e9df22b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:29 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Volume volume-260a6647-bb3a-480f-a45b-e44460b1ba19 (260a6647-bb3a-480f-a45b-e44460b1ba19): created successfully Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f848b8-fb6a-4554-b800-473e9df22b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (ab537f86-e903-4b80-b468-d6bc2200c943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2ec30d01-d497-49e3-8f03-a769b2776675 tempest-VolumesListAdminTestJSON-1204649371 None] Created volume successfully. Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "cinder-quobyte-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-quobyte-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae49d61-55ad-473c-a9a0-991cc782e072]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:30 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:15:30 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (e63d4aaf-584e-4765-a162-9a3c00b26ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:30 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bda4b0-25af-464a-954d-5c7e1490d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.452s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bda4b0-25af-464a-954d-5c7e1490d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1129062471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19cc236-17f4-445e-a9d8-ee68d5faea3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:30Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:30 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76 Jul 21 08:15:30 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb0951e-de75-457d-90bb-1034b47f2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb0951e-de75-457d-90bb-1034b47f2277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79df0cb5-37a7-45cc-93d4-6054a08274b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79df0cb5-37a7-45cc-93d4-6054a08274b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19cc236-17f4-445e-a9d8-ee68d5faea3e', 'volume_name': 'volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baedb1c9-f773-4892-80b1-10883438443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baedb1c9-f773-4892-80b1-10883438443b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78afc4ed-884a-4d44-86a6-5ddb00a3e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:30 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Volume a19cc236-17f4-445e-a9d8-ee68d5faea3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e', 'volume_size': 1} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1129062471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19cc236-17f4-445e-a9d8-ee68d5faea3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30be270fb04b499eb58da04352d6f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:30Z,use_quota=True,user_id='adfed733570c4b8a921319b8f80ced6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Creating volume a19cc236-17f4-445e-a9d8-ee68d5faea3e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:30 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:30 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e 1073741824 Jul 21 08:15:30 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:30 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-quobyte-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76" released by "delete_volume" :: held 0.875s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Created reservations ['b4101641-7961-4cd2-87a2-382cf35c926f', 'e73fde31-6463-4dbc-8cd1-2dc0cfb0e234', '5cf71bbb-5d01-4171-bb46-01e0a7f3e2ae', '83ff1076-425b-47bc-90ff-3c970a1063ed'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-21e0bcda-471e-4a8f-b17c-27ace050f664 req-abfee022-a01b-4c24-970d-116f3998eeb1 tempest-AttachVolumeNegativeTest-1805662753 None] Terminate volume connection completed successfully. Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-21e0bcda-471e-4a8f-b17c-27ace050f664 req-abfee022-a01b-4c24-970d-116f3998eeb1 tempest-AttachVolumeNegativeTest-1805662753 None] Deleting attachment d1d77015-6f86-485c-9205-ed9d5136cc79. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:15:31 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:31 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:31 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e 1073741824" returned: 0 in 0.698s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (720f961e-19b8-4d65-81f8-ca4f65d93190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e7f487-21d2-497d-a88f-cd538a617180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e7f487-21d2-497d-a88f-cd538a617180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-552333799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b32c3-0cf2-4090-a20b-aea570ba3c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:31Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e Jul 21 08:15:31 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0343bae-dcef-44c1-8013-354c9677bf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0343bae-dcef-44c1-8013-354c9677bf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7d54f-74c7-417e-bc7c-80a548b945cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf7d54f-74c7-417e-bc7c-80a548b945cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6b32c3-0cf2-4090-a20b-aea570ba3c9a', 'volume_name': 'volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3462267a-52c8-4730-add8-cdfde3c7e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3462267a-52c8-4730-add8-cdfde3c7e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a250f85-787e-430e-815a-c6d13092ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Volume da6b32c3-0cf2-4090-a20b-aea570ba3c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a', 'volume_size': 1} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.375s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Deleted volume successfully. Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bff3ebe2-bfe4-4afe-9b22-d9f15061fd62 tempest-VolumesActionsTest-1816501321 None] Lock "cinder-b2a8bd2d-c7e2-4433-91da-1adf1ca0ef76-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:31 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.210s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-552333799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6b32c3-0cf2-4090-a20b-aea570ba3c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:31Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Creating volume da6b32c3-0cf2-4090-a20b-aea570ba3c9a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78afc4ed-884a-4d44-86a6-5ddb00a3e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a3d71-f63c-43fb-b195-57e791493aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:31 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a 1073741824 Jul 21 08:15:31 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Volume volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e (a19cc236-17f4-445e-a9d8-ee68d5faea3e): created successfully Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06a3d71-f63c-43fb-b195-57e791493aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Flow 'volume_create_manager' (e63d4aaf-584e-4765-a162-9a3c00b26ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cc3d6047-f2ab-4d82-b301-8e50a436691a tempest-VolumesListAdminTestJSON-1204649371 None] Created volume successfully. Jul 21 08:15:32 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a 1073741824" returned: 0 in 0.583s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:32 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a Jul 21 08:15:32 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:32 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" returned: 0 in 0.497s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a250f85-787e-430e-815a-c6d13092ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2b1ea7-feb8-46dc-8d6a-c13b3dd9338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:32 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Volume volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a (da6b32c3-0cf2-4090-a20b-aea570ba3c9a): created successfully Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2b1ea7-feb8-46dc-8d6a-c13b3dd9338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (720f961e-19b8-4d65-81f8-ca4f65d93190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5e6ea3f4-3517-4803-992d-3094fe5c5e8d tempest-AttachVolumeTestJSON-595923900 None] Created volume successfully. Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Flow 'volume_create_manager' (1add7865-b502-4f14-992b-ceca5127b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d342d8-b821-4fc2-a75e-d3223ad29bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d342d8-b821-4fc2-a75e-d3223ad29bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db1b68-0159-4896-b479-76585001c2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2965b0cefa8b4971b51125404b7ebad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:34Z,use_quota=True,user_id='cb01bfc756734367ada610eec4eac961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1fa06a-8c93-4bc5-b76b-38e58f2d0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1fa06a-8c93-4bc5-b76b-38e58f2d0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294da63f-5b25-4d96-a165-2724284cca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294da63f-5b25-4d96-a165-2724284cca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17db1b68-0159-4896-b479-76585001c2c6', 'volume_name': 'volume-17db1b68-0159-4896-b479-76585001c2c6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2783ec2-cdfa-49f5-8583-898ad20fad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2783ec2-cdfa-49f5-8583-898ad20fad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05c933f-f352-4ff8-a703-f74008eeb11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:33 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Volume 17db1b68-0159-4896-b479-76585001c2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17db1b68-0159-4896-b479-76585001c2c6', 'volume_size': 1} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db1b68-0159-4896-b479-76585001c2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2965b0cefa8b4971b51125404b7ebad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:34Z,use_quota=True,user_id='cb01bfc756734367ada610eec4eac961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Creating volume 17db1b68-0159-4896-b479-76585001c2c6 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:33 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:34 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 1073741824 Jul 21 08:15:34 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-28aee341-c395-496f-8c27-0c73fc103dd9 req-04ee9046-9f8c-462b-8a18-49085b43147b tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:34 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 1073741824" returned: 0 in 0.683s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:34 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 Jul 21 08:15:34 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:35 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6" returned: 0 in 0.347s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-28aee341-c395-496f-8c27-0c73fc103dd9 req-04ee9046-9f8c-462b-8a18-49085b43147b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.504s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05c933f-f352-4ff8-a703-f74008eeb11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17db1b68-0159-4896-b479-76585001c2c6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4024568d-ff06-4857-b4b2-596d32cf1aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-28aee341-c395-496f-8c27-0c73fc103dd9 req-04ee9046-9f8c-462b-8a18-49085b43147b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Volume volume-17db1b68-0159-4896-b479-76585001c2c6 (17db1b68-0159-4896-b479-76585001c2c6): created successfully Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4024568d-ff06-4857-b4b2-596d32cf1aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Flow 'volume_create_manager' (1add7865-b502-4f14-992b-ceca5127b015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4ecb3bf0-bcd7-402a-b350-89563202f861 tempest-VolumesListAdminTestJSON-1506287725 None] Created volume successfully. Jul 21 08:15:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-28aee341-c395-496f-8c27-0c73fc103dd9 req-04ee9046-9f8c-462b-8a18-49085b43147b tempest-AttachVolumeTestJSON-595923900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f80c7bf-da01-4159-9d55-433a9f992f21', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:15:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-28aee341-c395-496f-8c27-0c73fc103dd9 req-04ee9046-9f8c-462b-8a18-49085b43147b tempest-AttachVolumeTestJSON-595923900 None] attachment_update completed successfully. Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Acquiring lock "cinder-17db1b68-0159-4896-b479-76585001c2c6-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "cinder-17db1b68-0159-4896-b479-76585001c2c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Acquiring lock "cinder-quobyte-17db1b68-0159-4896-b479-76585001c2c6" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "cinder-quobyte-17db1b68-0159-4896-b479-76585001c2c6" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b5494-2d03-4936-bc97-d8d86b5ad121]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-a19cc236-17f4-445e-a9d8-ee68d5faea3e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-a19cc236-17f4-445e-a9d8-ee68d5faea3e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-quobyte-a19cc236-17f4-445e-a9d8-ee68d5faea3e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-a19cc236-17f4-445e-a9d8-ee68d5faea3e" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:36 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 Jul 21 08:15:36 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e8739-a23f-4399-b955-12d1584f2ef5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:36 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e Jul 21 08:15:36 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-4910b143-7eab-410e-bcd8-523c6d827f85-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-4910b143-7eab-410e-bcd8-523c6d827f85-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-quobyte-4910b143-7eab-410e-bcd8-523c6d827f85" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-4910b143-7eab-410e-bcd8-523c6d827f85" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced81f36-a187-4cd1-826c-5b1ad28aed18]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6" returned: 0 in 0.775s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6 Jul 21 08:15:37 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 Jul 21 08:15:37 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e" returned: 0 in 0.739s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e Jul 21 08:15:37 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17db1b68-0159-4896-b479-76585001c2c6" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85" returned: 0 in 0.532s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "cinder-quobyte-17db1b68-0159-4896-b479-76585001c2c6" released by "delete_volume" :: held 1.358s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:37 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85 Jul 21 08:15:37 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a19cc236-17f4-445e-a9d8-ee68d5faea3e" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-a19cc236-17f4-445e-a9d8-ee68d5faea3e" released by "delete_volume" :: held 1.140s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Created reservations ['1dbd5abf-6fce-4c9a-b962-ea3cf11ba587', '8338809b-072d-460f-9247-91d81edd31ff', '39dccb60-eb30-43f7-970d-de2318b6a74e', 'c9349a03-4608-466d-bb10-877ba97498bf'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Created reservations ['215d070e-7c58-4533-a73e-ecd66a9dc7e8', '6fcff92d-b807-4328-9395-3efcdf2249b2', '08fbcd8f-1cf5-4386-951b-c5f0facbbdb7', 'f02b29bb-146b-4197-8bf5-a486e7b546b0'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:37 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:37 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4910b143-7eab-410e-bcd8-523c6d827f85" returned: 0 in 0.295s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:37 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:37 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-4910b143-7eab-410e-bcd8-523c6d827f85" released by "delete_volume" :: held 0.876s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Created reservations ['407fcc4a-1e0f-4e5c-9dbc-68a957758cf4', '9433793c-27f1-46ce-a4d5-e10170d09eac', 'b13ac53f-7e66-421a-a13a-09c1142934ef', '8fe2e228-1c27-45f2-a1d3-7128dffa5719'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:38 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.331s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Deleted volume successfully. Jul 21 08:15:38 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:38 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-822ba166-1886-49eb-8499-0c0c91bb15b4 tempest-VolumesListAdminTestJSON-1506287725 None] Lock "cinder-17db1b68-0159-4896-b479-76585001c2c6-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:38 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Deleted volume successfully. Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-caf72566-a103-4213-a27f-ad92a4f2a428 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-a19cc236-17f4-445e-a9d8-ee68d5faea3e-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-eca08d57-ae19-4422-9e53-aa40bce475da-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-eca08d57-ae19-4422-9e53-aa40bce475da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-quobyte-eca08d57-ae19-4422-9e53-aa40bce475da" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:38 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.366s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-eca08d57-ae19-4422-9e53-aa40bce475da" acquired by "delete_volume" :: waited 0.043s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Deleted volume successfully. Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37b41d-4a37-4482-855b-9ef0a18dae97]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-acad9ba6-5c7b-43d2-a2a0-88257d584799 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-4910b143-7eab-410e-bcd8-523c6d827f85-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:38 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da Jul 21 08:15:38 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-260a6647-bb3a-480f-a45b-e44460b1ba19-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-260a6647-bb3a-480f-a45b-e44460b1ba19-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-quobyte-260a6647-bb3a-480f-a45b-e44460b1ba19" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-260a6647-bb3a-480f-a45b-e44460b1ba19" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e35a5-447a-4a7d-a74e-105baca9234a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:39 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da" returned: 0 in 0.502s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:39 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da Jul 21 08:15:39 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:39 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 Jul 21 08:15:39 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:39 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eca08d57-ae19-4422-9e53-aa40bce475da" returned: 0 in 0.359s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-eca08d57-ae19-4422-9e53-aa40bce475da" released by "delete_volume" :: held 0.918s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:39 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19" returned: 0 in 0.423s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:39 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19 Jul 21 08:15:39 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Created reservations ['3588be67-6170-445d-b4f2-0c01ae958416', 'b66f77bc-8d6b-4e22-83d6-4b27b0613d43', 'de0556ac-5bca-4630-a59a-14a7d03cb7dc', '4d955ffa-ee0f-4782-bb55-46916ac5e6f2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:39 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:39 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:39 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-260a6647-bb3a-480f-a45b-e44460b1ba19" returned: 0 in 0.340s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-260a6647-bb3a-480f-a45b-e44460b1ba19" released by "delete_volume" :: held 0.826s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:39 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Created reservations ['d5e70dc9-93f9-416e-8942-5fda3797ad18', '9a162f85-8bde-4768-bfb8-c49b3786e0b7', '84a20611-014c-47be-9a59-c494615a4013', '5b65af00-505e-4c16-bd2e-0f72730f7003'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:40 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.446s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Deleted volume successfully. Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8cda3be9-83da-4a3a-b8f4-e0881b356cf0 tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-eca08d57-ae19-4422-9e53-aa40bce475da-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:40 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:40 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Flow 'volume_create_manager' (80c7dc14-ad2e-434e-bff0-3f44d4ba7c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3c73ed-4df0-466d-92f2-027fd9700e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-d15ac2d4-1ca4-432b-a7f4-71b0c307a931-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3c73ed-4df0-466d-92f2-027fd9700e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846061822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132f198c-209c-41e5-8d7c-ff5efe79ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a36586c2f745419a477bd6ded2601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:40Z,use_quota=True,user_id='6f29a1d8271d4245b1301b2e1cef0ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd5d323-641d-4f98-9154-61effe679cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd5d323-641d-4f98-9154-61effe679cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e46288-5c83-48d8-93e6-ec7ac46637ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e46288-5c83-48d8-93e6-ec7ac46637ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132f198c-209c-41e5-8d7c-ff5efe79ff25', 'volume_name': 'volume-132f198c-209c-41e5-8d7c-ff5efe79ff25', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6867255-e33b-4715-ac6f-7db5b2f58502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6867255-e33b-4715-ac6f-7db5b2f58502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21951ca-1d8b-4746-a9de-2fd4f8411beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Volume 132f198c-209c-41e5-8d7c-ff5efe79ff25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132f198c-209c-41e5-8d7c-ff5efe79ff25', 'volume_size': 1} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1846061822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132f198c-209c-41e5-8d7c-ff5efe79ff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a36586c2f745419a477bd6ded2601e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:40Z,use_quota=True,user_id='6f29a1d8271d4245b1301b2e1cef0ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Creating volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:40 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:40 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 1073741824 Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-d15ac2d4-1ca4-432b-a7f4-71b0c307a931-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:40 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:40 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.408s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Deleted volume successfully. Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "cinder-quobyte-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c15fabd8-7084-4116-a76a-41f8327af4c6 tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-260a6647-bb3a-480f-a45b-e44460b1ba19-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee89ba9-dfd3-4c72-b835-614c24220583]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:40 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 Jul 21 08:15:40 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-926ff5d3-1e29-4536-acef-cb5d42c9fdc7-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-926ff5d3-1e29-4536-acef-cb5d42c9fdc7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "cinder-quobyte-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:41 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" acquired by "delete_volume" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 1073741824" returned: 0 in 0.661s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58f41e4-d0f8-487b-844c-ca77da30974d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:41 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" returned: 0 in 0.466s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:41 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931 Jul 21 08:15:41 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:41 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 Jul 21 08:15:41 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:41 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 Jul 21 08:15:41 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:41 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" returned: 0 in 0.341s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-quobyte-d15ac2d4-1ca4-432b-a7f4-71b0c307a931" released by "delete_volume" :: held 0.901s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:41 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25" returned: 0 in 0.380s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21951ca-1d8b-4746-a9de-2fd4f8411beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132f198c-209c-41e5-8d7c-ff5efe79ff25', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5287080-0330-43a3-bde2-6182f5cbc915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Volume volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 (132f198c-209c-41e5-8d7c-ff5efe79ff25): created successfully Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5287080-0330-43a3-bde2-6182f5cbc915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Flow 'volume_create_manager' (80c7dc14-ad2e-434e-bff0-3f44d4ba7c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dc07af43-0071-42cf-9671-14c3fb7966ed tempest-VolumesSnapshotListTestJSON-1064983469 None] Created volume successfully. Jul 21 08:15:41 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" returned: 0 in 0.597s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Created reservations ['b61974b0-19f2-4938-8f5c-7ff32d9a623b', 'fec022f4-660b-4670-a704-1cfa680a02a6', '3b163f62-287a-4d31-a503-d7a871fc21b0', '7b13d948-29fb-4250-8c09-4c992928e040'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:41 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7 Jul 21 08:15:41 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:41 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:41 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:42 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:42 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Deleted volume successfully. Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" returned: 0 in 0.583s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-quobyte-926ff5d3-1e29-4536-acef-cb5d42c9fdc7" released by "delete_volume" :: held 1.260s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3058c37f-2ee0-4d4f-af57-39599f5a56aa tempest-VolumesListAdminTestJSON-1204649371 None] Lock "cinder-d15ac2d4-1ca4-432b-a7f4-71b0c307a931-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Created reservations ['4fffa886-75a5-4098-b972-7e59a2afcefb', 'c97ae66e-75f4-469f-a856-70bea00aad65', 'bf9fe0a0-4a41-45aa-addd-4300c168f1b3', '2593b7da-636f-4801-bf95-9dd020103d4e'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Creating offline snapshot e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded7cb5a-7fd0-436b-bc84-ba0a102049fa]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:42 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:42 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:42 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 Jul 21 08:15:42 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:43 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:43 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Deleted volume successfully. Jul 21 08:15:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc34162a-50fd-4512-abaa-c2690ca3c80a tempest-AttachVolumeNegativeTest-1805662753 None] Lock "cinder-926ff5d3-1e29-4536-acef-cb5d42c9fdc7-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:43 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25" returned: 0 in 0.447s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:43 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 1G Jul 21 08:15:43 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:44 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 1G" returned: 0 in 0.873s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:44 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:44 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:44 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.454s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:44 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 is being set with open permissions: ugo+rw Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:44 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:44 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:44 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.395s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:45 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info Jul 21 08:15:45 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:45 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:45 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info is being set with open permissions: ugo+rw Jul 21 08:15:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:45 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info Jul 21 08:15:45 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:45 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.info" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3936249c-9f77-49d7-9724-3f0359dc5415 tempest-VolumesSnapshotListTestJSON-1064983469 None] Create snapshot completed successfully Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Creating offline snapshot 11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64cdd4-a973-4436-be06-269430d16f07]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:46 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:46 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:46 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.548s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:46 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 1G Jul 21 08:15:46 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:47 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 1G" returned: 0 in 0.603s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:47 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:47 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:47 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.336s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:47 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 is being set with open permissions: ugo+rw Jul 21 08:15:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:47 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:47 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:48 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.286s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-85891ef1-48c7-4a4f-a31b-31f148b9b6f9 tempest-VolumesSnapshotListTestJSON-1064983469 None] Create snapshot completed successfully Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Creating offline snapshot 872985b7-2c56-45d7-97e5-526350578d5a of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b32b987-d260-4387-9dd4-86c45063274c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:48 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:48 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:49 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.580s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:49 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a 1G Jul 21 08:15:49 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:50 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a 1G" returned: 0 in 0.664s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:50 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a Jul 21 08:15:50 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:50 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:50 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a is being set with open permissions: ugo+rw Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:50 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a Jul 21 08:15:50 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Flow 'volume_create_manager' (f7e23591-615e-4748-a8cf-baac0c0a08e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e39e667-7191-4334-8e72-dd3396b2f421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e39e667-7191-4334-8e72-dd3396b2f421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1773057233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723fdd12-21a9-4235-8dbc-b73117749316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86dc320cbe14e55b55ca6e0e6d47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:51Z,use_quota=True,user_id='5b700e2475ea4553bbb0e5000268562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b893236-08ea-4470-99df-c42e179994a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b893236-08ea-4470-99df-c42e179994a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d4a5a-a4a6-401d-8ca5-aaaabc73d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378d4a5a-a4a6-401d-8ca5-aaaabc73d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '723fdd12-21a9-4235-8dbc-b73117749316', 'volume_name': 'volume-723fdd12-21a9-4235-8dbc-b73117749316', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6018a5-a033-445a-b98e-adb7c70dc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6018a5-a033-445a-b98e-adb7c70dc15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88615b45-544d-4024-a51f-b3638c68e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:50 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Volume 723fdd12-21a9-4235-8dbc-b73117749316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-723fdd12-21a9-4235-8dbc-b73117749316', 'volume_size': 1} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:50 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1773057233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723fdd12-21a9-4235-8dbc-b73117749316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86dc320cbe14e55b55ca6e0e6d47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:51Z,use_quota=True,user_id='5b700e2475ea4553bbb0e5000268562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Creating volume 723fdd12-21a9-4235-8dbc-b73117749316 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:50 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:50 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 1073741824 Jul 21 08:15:50 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0188ab32-5d0f-4317-b103-767da6ff5f91 tempest-VolumesSnapshotListTestJSON-1064983469 None] Create snapshot completed successfully Jul 21 08:15:51 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 1073741824" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:51 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 Jul 21 08:15:51 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:51 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316" returned: 0 in 0.262s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88615b45-544d-4024-a51f-b3638c68e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723fdd12-21a9-4235-8dbc-b73117749316', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf00c0-6b04-4282-8c5e-4337efd8baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:51 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Volume volume-723fdd12-21a9-4235-8dbc-b73117749316 (723fdd12-21a9-4235-8dbc-b73117749316): created successfully Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bf00c0-6b04-4282-8c5e-4337efd8baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Flow 'volume_create_manager' (f7e23591-615e-4748-a8cf-baac0c0a08e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:51 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a3de42b7-83e3-403b-b27a-39fa109159fc tempest-VolumesTransfersTest-786026447 None] Created volume successfully. Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:52 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:52 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-872985b7-2c56-45d7-97e5-526350578d5a-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-872985b7-2c56-45d7-97e5-526350578d5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-872985b7-2c56-45d7-97e5-526350578d5a" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-872985b7-2c56-45d7-97e5-526350578d5a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Deleting offline snapshot 872985b7-2c56-45d7-97e5-526350578d5a of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] snapshot_file for this snap is: volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e77932-98f8-48b5-a4c0-41034a62246d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:53 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.512s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:15:53 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a Jul 21 08:15:53 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:53 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a" returned: 0 in 0.448s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[37025270-778e-480e-93f8-35961991c11d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:53 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:53 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Flow 'volume_create_manager' (ca643592-3523-49fb-ade2-7fbaa98609b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47298078-1d87-40e4-826d-79c03f9555e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47298078-1d87-40e4-826d-79c03f9555e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-290852465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c54cdfc9394f629bce9200561163b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:54Z,use_quota=True,user_id='b0dda638a70643a0b33ec843d8d34907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833534c7-b6d8-49c4-84ec-2032dbb7e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833534c7-b6d8-49c4-84ec-2032dbb7e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9727b9-4d8d-4828-827b-a24795560a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9727b9-4d8d-4828-827b-a24795560a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3', 'volume_name': 'volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad61cde-4dcd-49dc-85af-b44fbe81d871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad61cde-4dcd-49dc-85af-b44fbe81d871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f201dcb-ba9a-4916-892d-4b82f80f9757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:53 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Volume 2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3', 'volume_size': 1} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-290852465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c54cdfc9394f629bce9200561163b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:54Z,use_quota=True,user_id='b0dda638a70643a0b33ec843d8d34907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Creating volume 2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:53 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:53 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 1073741824 Jul 21 08:15:53 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54d56a32-7f73-4998-ba47-37871d64ca23 tempest-VolumesTransfersTest-19431748 None] Transfer volume completed successfully. Jul 21 08:15:54 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.585s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:54 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a Jul 21 08:15:54 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:54 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 1073741824" returned: 0 in 0.576s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:54 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 Jul 21 08:15:54 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:54 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Acquiring lock "cinder-723fdd12-21a9-4235-8dbc-b73117749316-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "cinder-723fdd12-21a9-4235-8dbc-b73117749316-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:54 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a Jul 21 08:15:54 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Acquiring lock "cinder-quobyte-723fdd12-21a9-4235-8dbc-b73117749316" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "cinder-quobyte-723fdd12-21a9-4235-8dbc-b73117749316" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ceb8f0-040b-4fa9-afeb-544d56994ead]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:54 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" returned: 0 in 0.394s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f201dcb-ba9a-4916-892d-4b82f80f9757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d7ab37-3eb2-461b-b620-af96a92f8a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:54 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Volume volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 (2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3): created successfully Jul 21 08:15:54 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 Jul 21 08:15:54 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d7ab37-3eb2-461b-b620-af96a92f8a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:54 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Flow 'volume_create_manager' (ca643592-3523-49fb-ade2-7fbaa98609b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-1034ac52-569b-4a54-8e8a-9a6adb2000ea req-4277f2ad-b200-457c-9d27-e219edcfd0fd tempest-VolumesSnapshotsTestJSON-1103876944 None] Created volume successfully. Jul 21 08:15:55 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.872985b7-2c56-45d7-97e5-526350578d5a" returned: 0 in 0.375s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-872985b7-2c56-45d7-97e5-526350578d5a" released by "_delete_snapshot" :: held 2.069s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" released by "delete_snapshot" :: held 2.110s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Created reservations ['eecb4509-11a0-4e62-b236-e7e9095027cb', '0b7abddd-e3dd-44ac-bdb4-1c43f6084c0f', '0e26d13d-f832-4a9d-b40c-e422903d07cc', 'ec065fc7-efc5-4674-ac7e-8589392eedd0'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Delete snapshot completed successfully. Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3a02b94c-b897-457d-8395-e2cf2018a320 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-872985b7-2c56-45d7-97e5-526350578d5a-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:55 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316" returned: 0 in 0.454s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:55 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316 Jul 21 08:15:55 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:55 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-723fdd12-21a9-4235-8dbc-b73117749316" returned: 0 in 0.242s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "cinder-quobyte-723fdd12-21a9-4235-8dbc-b73117749316" released by "delete_volume" :: held 0.750s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Created reservations ['8e1ae8a1-958d-4f22-b856-843d569a6d2f', '8eb7a140-83f1-493d-953a-afb177c06220', 'f09d0d79-ecdb-46a7-9d83-6e3ba1dc9aa9', '9b1e335c-fd23-4cf5-ab31-06fb3b7d950a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:55 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:15:55 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:55 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:15:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Deleted volume successfully. Jul 21 08:15:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b77c8713-0af3-429c-bd61-78eca9e8acda tempest-VolumesTransfersTest-907123883 None] Lock "cinder-723fdd12-21a9-4235-8dbc-b73117749316-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Deleting offline snapshot 11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] snapshot_file for this snap is: volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b52f14-574a-4efc-bd26-a5d2e60ffc48]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Flow 'volume_create_manager' (6b514676-54fa-4986-b7fc-a52d77dee4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd9c7f5-1092-4069-8ef8-910911744005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd9c7f5-1092-4069-8ef8-910911744005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1202840683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dd5b9a-4fde-4594-bc3d-33c9e953f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86dc320cbe14e55b55ca6e0e6d47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:57Z,use_quota=True,user_id='5b700e2475ea4553bbb0e5000268562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f141c3-0703-46f1-9192-6916c508a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:56 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:56 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f141c3-0703-46f1-9192-6916c508a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714a5b4e-1f1f-49d2-8cde-be8663c3e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714a5b4e-1f1f-49d2-8cde-be8663c3e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19dd5b9a-4fde-4594-bc3d-33c9e953f3c8', 'volume_name': 'volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4545094-94cc-4b66-a25a-af66a66897b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4545094-94cc-4b66-a25a-af66a66897b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c787b249-27e9-44a2-a97c-69d5c503e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Volume 19dd5b9a-4fde-4594-bc3d-33c9e953f3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8', 'volume_size': 1} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Creating offline snapshot f835e6f2-1c9f-445f-9578-a786fbb45584 of volume 2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782a464-0fdb-48fc-b225-6248c018b35a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:56 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 Jul 21 08:15:56 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:56 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.438s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cfd0d7-1a42-4683-b9a3-cae2697c02ac]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:57 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:57 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" returned: 0 in 0.367s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 1G Jul 21 08:15:57 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:57 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:57 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:57 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 1G" returned: 0 in 0.421s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 Jul 21 08:15:57 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:57 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.392s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3 Jul 21 08:15:57 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:57 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584" returned: 0 in 0.323s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:57 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 is being set with open permissions: ugo+rw Jul 21 08:15:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:57 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 Jul 21 08:15:57 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:58 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" returned: 0 in 0.249s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3" released by "_delete_snapshot" :: held 1.579s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" released by "delete_snapshot" :: held 1.603s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Created reservations ['c70bf2db-5d52-46d1-9fa1-bc3be135f1da', '7d31a4dc-a180-4cf8-9c4a-d4647887e773', '0560e504-0723-403b-a8be-e471d49a7de8', '8a2361ea-9553-4369-a9a5-fd9a2d3e1773'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:15:58 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584" returned: 0 in 0.243s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Delete snapshot completed successfully. Jul 21 08:15:58 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info Jul 21 08:15:58 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-808c5a37-d447-40a2-af27-d4f70cc5468a tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-11aca88b-a7be-4a1f-b1f9-91f91fc0c9e3-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:15:58 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info" returned: 0 in 0.248s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:58 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info is being set with open permissions: ugo+rw Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:58 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info Jul 21 08:15:58 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Deleting offline snapshot e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 of volume 132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] snapshot_file for this snap is: volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a54da-e22a-4a02-aa2a-4d2596b1c16a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:58 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.info" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1202840683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dd5b9a-4fde-4594-bc3d-33c9e953f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86dc320cbe14e55b55ca6e0e6d47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:15:57Z,use_quota=True,user_id='5b700e2475ea4553bbb0e5000268562a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Creating volume 19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:15:58 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:15:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:58 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 1073741824 Jul 21 08:15:58 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-db47babe-187f-491d-87ae-dd49aea6b69a req-814b27ff-75db-467a-8dfc-a384d1c24f92 tempest-VolumesSnapshotsTestJSON-1103876944 None] Create snapshot completed successfully Jul 21 08:15:58 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:58 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:59 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.388s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-132f198c-209c-41e5-8d7c-ff5efe79ff25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b9099-d01d-49de-b0c7-d10431ea975f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:59 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 1073741824" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:59 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 Jul 21 08:15:59 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:59 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 Jul 21 08:15:59 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:59 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c787b249-27e9-44a2-a97c-69d5c503e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:59 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ab9113-203b-4d42-847c-4d930381a65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:59 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Volume volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 (19dd5b9a-4fde-4594-bc3d-33c9e953f3c8): created successfully Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ab9113-203b-4d42-847c-4d930381a65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:15:59 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:59 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Flow 'volume_create_manager' (6b514676-54fa-4986-b7fc-a52d77dee4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:15:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d3e32bed-31b7-4992-b345-e72bc342002e tempest-VolumesTransfersTest-786026447 None] Created volume successfully. Jul 21 08:15:59 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "cinder-f835e6f2-1c9f-445f-9578-a786fbb45584-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-f835e6f2-1c9f-445f-9578-a786fbb45584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:59 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9 Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Acquiring lock "cinder-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:59 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "cinder-quobyte-f835e6f2-1c9f-445f-9578-a786fbb45584" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "cinder-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-f835e6f2-1c9f-445f-9578-a786fbb45584" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Deleting offline snapshot f835e6f2-1c9f-445f-9578-a786fbb45584 of volume 2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:15:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] snapshot_file for this snap is: volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ec06f-3ee4-4358-b133-c0b0deb162e8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Acquiring lock "cinder-quobyte-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "cinder-quobyte-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff6e5f-0cd9-431b-963a-838822b05f6f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 Jul 21 08:16:00 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:00 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25.e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" returned: 0 in 0.302s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:00 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 Jul 21 08:16:00 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9" released by "_delete_snapshot" :: held 1.609s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" released by "delete_snapshot" :: held 1.634s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Created reservations ['9a40800b-bea5-495a-95e3-06c970a00ac9', '810b3ced-987c-42c7-bd1c-525430f69b22', 'fa6105d0-b9c6-4f13-b8bf-9472b64573a1', '511c9515-b225-47a7-972f-6632f49509fa'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:00 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Delete snapshot completed successfully. Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5dad5807-5580-4a82-9498-736d9e22dd86 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-e253a8f3-0ca2-40ab-936c-9ca2c9fa9df9-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:00 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584" returned: 0 in 0.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[235b600e-bf5d-4fb6-8151-88c125fe6d13]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" returned: 0 in 0.403s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8 Jul 21 08:16:00 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:00 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 Jul 21 08:16:00 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:00 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "cinder-quobyte-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8" released by "delete_volume" :: held 0.712s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-132f198c-209c-41e5-8d7c-ff5efe79ff25-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-132f198c-209c-41e5-8d7c-ff5efe79ff25-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Created reservations ['49fba31c-42ab-4289-952a-173e8f24a1ca', 'a09a6c00-b9c2-4d65-84cb-cccead551eda', '673f6834-995e-4a2c-9481-e291046719df', '7d2b18a0-2171-4852-a2d7-2b63244332b2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:00 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" returned: 0 in 0.417s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:00 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 Jul 21 08:16:00 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f8ed9e-7ad0-4613-9734-854fa8fd9a4d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:01 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:01 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:01 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 Jul 21 08:16:01 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:01 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Deleted volume successfully. Jul 21 08:16:01 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584" returned: 0 in 0.409s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d257d746-3611-482b-8cae-82a435c2dc03 tempest-VolumesTransfersTest-907123883 None] Lock "cinder-19dd5b9a-4fde-4594-bc3d-33c9e953f3c8-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:01 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584 Jul 21 08:16:01 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:01 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25" returned: 0 in 0.449s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:01 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25 Jul 21 08:16:01 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:01 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3.f835e6f2-1c9f-445f-9578-a786fbb45584" returned: 0 in 0.305s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-f835e6f2-1c9f-445f-9578-a786fbb45584" released by "_delete_snapshot" :: held 1.672s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" released by "delete_snapshot" :: held 1.711s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:01 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-132f198c-209c-41e5-8d7c-ff5efe79ff25" returned: 0 in 0.274s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-quobyte-132f198c-209c-41e5-8d7c-ff5efe79ff25" released by "delete_volume" :: held 0.796s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.quota [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Created reservations ['793014e0-8f35-47e7-b7d6-d3524516c998', '2eed43f9-eeb4-4a3b-bfa8-ca7a056d43d6', '88306346-e233-4403-bb5a-7944eee797d4', 'cafa76f7-0de6-424a-9b55-94604c81291f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Created reservations ['ebfe0e34-79d6-4be1-956c-38d6a1b28ee4', 'bfa20836-571d-4bc3-9474-bd2c3bda14cf', 'a18ea9eb-6578-4c3b-91e8-8dbabaa398c8', 'ecdffb58-8882-43d1-bf0d-88ab7bfe3262'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Delete snapshot completed successfully. Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-8088a052-1c89-40ae-9c55-506d666433af req-602b36ba-a2cd-4996-aec2-3433dacd89d5 tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-f835e6f2-1c9f-445f-9578-a786fbb45584-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:01 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:01 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:02 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Deleted volume successfully. Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "cinder-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6786f357-134b-4538-bb43-d1cb00cb2603 tempest-VolumesSnapshotListTestJSON-1064983469 None] Lock "cinder-132f198c-209c-41e5-8d7c-ff5efe79ff25-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ccf9cd-f6e5-4132-9fd8-20eef5fcf4ab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:02 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 Jul 21 08:16:02 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:02 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:02 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3 Jul 21 08:16:02 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:03 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" returned: 0 in 0.277s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-quobyte-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3" released by "delete_volume" :: held 0.777s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.quota [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Created reservations ['20a21b84-5c2c-4c35-a3bf-dcee21d2085d', '34de04e1-48cf-4d3e-b775-9fae7897f570', '40cae80b-6ff0-4f49-9333-ee618b6056ce', '01b43a24-3c55-49e9-a339-66c2e74214b1'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:03 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:03 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:03 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.manager [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:03 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Deleted volume successfully. Jul 21 08:16:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-a842760a-83e4-4e15-8760-4ac5ba3bd0ee req-7717e4ef-9034-42df-88cb-a4a7a1f513ef tempest-VolumesSnapshotsTestJSON-1103876944 None] Lock "cinder-2b3f6e54-15ad-43ba-97c6-0c2abe25ebb3-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-4e0bcd9d-7ef3-4807-819d-65c77583a487 req-2301147e-ca6e-4209-b6f8-4f346751cf25 tempest-AttachVolumeTestJSON-595923900 None] Terminate volume connection completed successfully. Jul 21 08:16:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-4e0bcd9d-7ef3-4807-819d-65c77583a487 req-2301147e-ca6e-4209-b6f8-4f346751cf25 tempest-AttachVolumeTestJSON-595923900 None] Deleting attachment 9f80c7bf-da01-4159-9d55-433a9f992f21. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (4450249b-be9f-4eaa-89a5-15a9dd94df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e45cc3-edf2-4f01-9fa0-00a2f650b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e45cc3-edf2-4f01-9fa0-00a2f650b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809271297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f691bd-3ac6-4874-b0e3-b5832a916823,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:09Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699e7605-d08b-4369-9358-6ce812bf0dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699e7605-d08b-4369-9358-6ce812bf0dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25324830-b9cc-4e73-b6fc-7c750802a6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25324830-b9cc-4e73-b6fc-7c750802a6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f691bd-3ac6-4874-b0e3-b5832a916823', 'volume_name': 'volume-c4f691bd-3ac6-4874-b0e3-b5832a916823', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e081261b-a5fc-40fe-bf40-aff60c7b381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e081261b-a5fc-40fe-bf40-aff60c7b381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c649c1-fc6c-40ee-8de2-3f9df547d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Volume c4f691bd-3ac6-4874-b0e3-b5832a916823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f691bd-3ac6-4874-b0e3-b5832a916823', 'volume_size': 1} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809271297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f691bd-3ac6-4874-b0e3-b5832a916823,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:09Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Creating volume c4f691bd-3ac6-4874-b0e3-b5832a916823 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:09 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:09 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 1073741824 Jul 21 08:16:09 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:09 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 1073741824" returned: 0 in 0.577s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:09 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 Jul 21 08:16:09 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:10 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823" returned: 0 in 0.292s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c649c1-fc6c-40ee-8de2-3f9df547d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f691bd-3ac6-4874-b0e3-b5832a916823', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ede0ea3-dad4-4472-9794-fefdf63f5c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Volume volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 (c4f691bd-3ac6-4874-b0e3-b5832a916823): created successfully Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ede0ea3-dad4-4472-9794-fefdf63f5c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (4450249b-be9f-4eaa-89a5-15a9dd94df9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a52bc27b-8173-4cd6-bbea-be72759dc6c4 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (67abf316-7905-40f9-81be-e9f437ad49c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d552df-f690-4a65-a244-f5113d422697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d552df-f690-4a65-a244-f5113d422697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1988194865',display_name='tempest-VolumesGetTest-Volume-926572774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef1f288-fcbb-430b-96d0-ac077dfa9bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:12Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa28cd6-d7ec-4997-a761-89b2c5b5dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa28cd6-d7ec-4997-a761-89b2c5b5dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7976c469-2c19-43f2-8a98-421269c4aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7976c469-2c19-43f2-8a98-421269c4aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef1f288-fcbb-430b-96d0-ac077dfa9bdc', 'volume_name': 'volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ba4542-6c89-4dfa-9d5f-d094f0f1c274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44ba4542-6c89-4dfa-9d5f-d094f0f1c274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c72217-6d6d-4a30-82e5-9aba647c49e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Volume 2ef1f288-fcbb-430b-96d0-ac077dfa9bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc', 'volume_size': 1} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1988194865',display_name='tempest-VolumesGetTest-Volume-926572774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef1f288-fcbb-430b-96d0-ac077dfa9bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:12Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Creating volume 2ef1f288-fcbb-430b-96d0-ac077dfa9bdc {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:12 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:12 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc 1073741824 Jul 21 08:16:12 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:13 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc 1073741824" returned: 0 in 0.691s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:13 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc Jul 21 08:16:13 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:13 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" returned: 0 in 0.544s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c72217-6d6d-4a30-82e5-9aba647c49e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3fc8c0-fa41-4628-aaf4-847481ad24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Volume volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc (2ef1f288-fcbb-430b-96d0-ac077dfa9bdc): created successfully Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d3fc8c0-fa41-4628-aaf4-847481ad24d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (67abf316-7905-40f9-81be-e9f437ad49c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dcf2d853-2175-434d-b702-7d78f10557a3 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "cinder-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=134,cinder:INSERT=42,cinder:UPDATE=156,cinder:DELETE=14 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" acquired by "delete_volume" :: waited 0.064s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f4c49-1cac-4646-80f9-7dd7873195ea]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:15 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc Jul 21 08:16:15 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e563b2a9-c5c7-433c-8471-ab939a20b02b tempest-GroupSnapshotsV319Test-1916227258 None] Group tempest-GroupSnapshotsV319Test-Group-939719093: creating Jul 21 08:16:15 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e563b2a9-c5c7-433c-8471-ab939a20b02b tempest-GroupSnapshotsV319Test-1916227258 None] Group tempest-GroupSnapshotsV319Test-Group-939719093: created successfully Jul 21 08:16:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" returned: 0 in 0.790s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e563b2a9-c5c7-433c-8471-ab939a20b02b tempest-GroupSnapshotsV319Test-1916227258 None] Create group completed successfully. Jul 21 08:16:15 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc Jul 21 08:16:15 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:16 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" returned: 0 in 0.504s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc" released by "delete_volume" :: held 1.435s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=134,cinder:UPDATE=170,cinder:DELETE=14,cinder:INSERT=36 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Created reservations ['e7fe795b-070b-4302-b0f0-2296e3cc34bf', '5c2fe620-2fa1-47c0-ad66-cf421fd358b0', '02d7a9be-87a6-49d9-b11b-90f70296a40a', 'e9f981c6-88b3-430c-b890-03e01bdb5971'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:16 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:16 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:16 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:16:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1648f783-affc-4778-a9bf-ee9452ed35d0 tempest-VolumesGetTest-2141948707 None] Lock "cinder-2ef1f288-fcbb-430b-96d0-ac077dfa9bdc-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-c4f691bd-3ac6-4874-b0e3-b5832a916823-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "cinder-c4f691bd-3ac6-4874-b0e3-b5832a916823-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-c4f691bd-3ac6-4874-b0e3-b5832a916823" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-c4f691bd-3ac6-4874-b0e3-b5832a916823" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd237e-17f9-4ebf-be97-c359314451fa]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:17 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 Jul 21 08:16:17 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Flow 'volume_create_manager' (2389424a-dc85-41f4-9c70-f1032fa5041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd85d395-143e-4297-8d89-d6d5fef72bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd85d395-143e-4297-8d89-d6d5fef72bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830480520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00061625-2d1c-42de-84e5-949d3e130d62,host='devstack@QuobyteHD#QuobyteHD',id=914a90cf-d7d7-46df-a67d-4f2282cb9300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c41c65f9fe14ff5a017c604bd8cd0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:18Z,use_quota=True,user_id='72696479fed045cda6d9c2eafef7e90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f53ea8f-ca5e-4ee5-b76f-c8a5d9d6de5c),volume_type_id=7f53ea8f-ca5e-4ee5-b76f-c8a5d9d6de5c)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e138bdaf-2ad3-4aeb-a04d-a70bc44ecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e138bdaf-2ad3-4aeb-a04d-a70bc44ecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d5d40-afda-4928-870d-3a7a973adcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d5d40-afda-4928-870d-3a7a973adcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914a90cf-d7d7-46df-a67d-4f2282cb9300', 'volume_name': 'volume-914a90cf-d7d7-46df-a67d-4f2282cb9300', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39322094-8e66-4517-91d8-7097cc993ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39322094-8e66-4517-91d8-7097cc993ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18420c4a-52dd-4366-b95d-f5803fab88e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Volume 914a90cf-d7d7-46df-a67d-4f2282cb9300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914a90cf-d7d7-46df-a67d-4f2282cb9300', 'volume_size': 1} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00061625-2d1c-42de-84e5-949d3e130d62,created_at=2026-07-21T06:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830480520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00061625-2d1c-42de-84e5-949d3e130d62,host='devstack@QuobyteHD#QuobyteHD',id=914a90cf-d7d7-46df-a67d-4f2282cb9300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c41c65f9fe14ff5a017c604bd8cd0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:18Z,use_quota=True,user_id='72696479fed045cda6d9c2eafef7e90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f53ea8f-ca5e-4ee5-b76f-c8a5d9d6de5c),volume_type_id=7f53ea8f-ca5e-4ee5-b76f-c8a5d9d6de5c)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Creating volume 914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:17 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:17 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 1073741824 Jul 21 08:16:17 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:17 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823" returned: 0 in 0.599s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:18 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823 Jul 21 08:16:18 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:18 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4f691bd-3ac6-4874-b0e3-b5832a916823" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-c4f691bd-3ac6-4874-b0e3-b5832a916823" released by "delete_volume" :: held 1.139s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Created reservations ['84759a7f-fb3f-43b3-8f11-a7e2ad98bf50', '481462a1-c5bb-4615-a9ce-fb3b2066fc66', '84f1861f-08f4-4c2c-8174-84f030f3f427', '3f4f5bb4-2aaa-4bfa-b60d-e57dc795e6cf'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:18 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 1073741824" returned: 0 in 0.762s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:18 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:18 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:18 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 Jul 21 08:16:18 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:19 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:16:19 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300" returned: 0 in 0.446s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18420c4a-52dd-4366-b95d-f5803fab88e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914a90cf-d7d7-46df-a67d-4f2282cb9300', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfae0da9-ed14-43b2-b02b-84c00de83f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f2021a20-ccb9-4aeb-b067-ba03cb9befcb tempest-VolumesGetTest-2141948707 None] Lock "cinder-c4f691bd-3ac6-4874-b0e3-b5832a916823-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Volume volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 (914a90cf-d7d7-46df-a67d-4f2282cb9300): created successfully Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfae0da9-ed14-43b2-b02b-84c00de83f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Flow 'volume_create_manager' (2389424a-dc85-41f4-9c70-f1032fa5041a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-749e5b31-a37a-41c9-90da-61687100bdef tempest-GroupSnapshotsV319Test-1916227258 None] Created volume successfully. Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (d574230f-884f-48ba-981a-ff74d864ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dda0906-9cae-4193-901c-a91353d4a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dda0906-9cae-4193-901c-a91353d4a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1790879856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f731046-6395-4546-81e6-2d737c1d80f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:20Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a11fff-2d81-4ba0-8cc5-e03773c65a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a11fff-2d81-4ba0-8cc5-e03773c65a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53291c12-d392-4215-ac36-66fa082096c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53291c12-d392-4215-ac36-66fa082096c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f731046-6395-4546-81e6-2d737c1d80f8', 'volume_name': 'volume-7f731046-6395-4546-81e6-2d737c1d80f8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfef1a1-8fc6-46e0-b62b-35db86af4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfef1a1-8fc6-46e0-b62b-35db86af4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c6c6fd-5e7f-4bac-a1ed-d7ae1cd7d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Volume 7f731046-6395-4546-81e6-2d737c1d80f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f731046-6395-4546-81e6-2d737c1d80f8', 'volume_size': 1} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1790879856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f731046-6395-4546-81e6-2d737c1d80f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:20Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Creating volume 7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:20 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:20 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 1073741824 Jul 21 08:16:20 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] GroupSnapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: creating. Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Group snapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: creating. {{(pid=87372) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:20 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 1073741824" returned: 0 in 0.510s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:20 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:20 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:21 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.285s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.572s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c6c6fd-5e7f-4bac-a1ed-d7ae1cd7d140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f731046-6395-4546-81e6-2d737c1d80f8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0e9a62-10f5-4f31-a75d-cd249a8795ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Creating offline snapshot 7b926515-3d6e-418e-878f-a2f1b6c6df7d of volume 914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:16:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Volume volume-7f731046-6395-4546-81e6-2d737c1d80f8 (7f731046-6395-4546-81e6-2d737c1d80f8): created successfully Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0e9a62-10f5-4f31-a75d-cd249a8795ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (d574230f-884f-48ba-981a-ff74d864ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1903bfd-c760-4887-ae72-e8dfe6cc0a83]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bfc44119-53dd-498c-b783-7dbb937f6070 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:16:21 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 Jul 21 08:16:21 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:21 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300" returned: 0 in 0.492s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:21 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d 1G Jul 21 08:16:21 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:22 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d 1G" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:22 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d Jul 21 08:16:22 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:22 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d" returned: 0 in 0.521s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:22 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:16:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:22 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d Jul 21 08:16:22 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:22 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (6ffe842c-eba6-484d-b02e-343cbc796765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdcdffd-0aae-41c5-8f01-f28b8519b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdcdffd-0aae-41c5-8f01-f28b8519b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-197637195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec252fb-059e-42e8-8a3b-ce9e4d5784d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7f731046-6395-4546-81e6-2d737c1d80f8,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:23Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f107582-f953-4fd3-b76e-940a1b0e4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f107582-f953-4fd3-b76e-940a1b0e4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6726d18f-eb1e-478c-9bd3-ee1a63fdc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6726d18f-eb1e-478c-9bd3-ee1a63fdc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ec252fb-059e-42e8-8a3b-ce9e4d5784d2', 'volume_name': 'volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2', 'volume_size': 1, 'source_volid': '7f731046-6395-4546-81e6-2d737c1d80f8', 'source_volstatus': 'available'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61642a0f-c2cc-4164-a83d-31213934af21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61642a0f-c2cc-4164-a83d-31213934af21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ea7906-e2f1-459d-8c27-f21efbb74258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Volume 8ec252fb-059e-42e8-8a3b-ce9e4d5784d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2', 'volume_size': 1, 'source_volid': '7f731046-6395-4546-81e6-2d737c1d80f8', 'source_volstatus': 'available'} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:23 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d" returned: 0 in 0.372s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:23 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info Jul 21 08:16:23 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:23 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info" returned: 0 in 0.281s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:23 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:23 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info Jul 21 08:16:23 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:23 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.info" returned: 0 in 0.328s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.741s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:23 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Cloning volume 7f731046-6395-4546-81e6-2d737c1d80f8 to volume 8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Creating offline snapshot f5859fb5-164b-48b9-b8dd-0944a4bd7f57 of volume 7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496c4fb-b406-49e0-ba86-40f63bcf6b48]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cd23bc78-c7c2-4660-a19c-85e4d33f4f33 tempest-GroupSnapshotsV319Test-1916227258 None] group_snapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: created successfully Jul 21 08:16:24 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:24 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:24 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.504s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:24 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 1G Jul 21 08:16:24 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:24 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 1G" returned: 0 in 0.478s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f731046-6395-4546-81e6-2d737c1d80f8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:24 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f731046-6395-4546-81e6-2d737c1d80f8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:24 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:25 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f731046-6395-4546-81e6-2d737c1d80f8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:25 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 is being set with open permissions: ugo+rw Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:25 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:25 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] group_snapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: deleting Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] group_snapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: deleting {{(pid=87372) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "cinder-quobyte-7b926515-3d6e-418e-878f-a2f1b6c6df7d" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-7b926515-3d6e-418e-878f-a2f1b6c6df7d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Deleting offline snapshot 7b926515-3d6e-418e-878f-a2f1b6c6df7d of volume 914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:16:25 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] snapshot_file for this snap is: volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.555s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c180da56-de67-480f-a1c2-d7e7e14266b6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:26 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info Jul 21 08:16:26 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:26 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d Jul 21 08:16:26 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:26 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:26 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info is being set with open permissions: ugo+rw Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:26 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info Jul 21 08:16:26 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:26 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d" returned: 0 in 0.580s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-914a90cf-d7d7-46df-a67d-4f2282cb9300(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8e0f9a-cb96-4513-bc5a-296d9566388b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:26 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 Jul 21 08:16:26 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:26 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.info" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] snapshot: f5859fb5-164b-48b9-b8dd-0944a4bd7f57, volume: 8ec252fb-059e-42e8-8a3b-ce9e4d5784d2, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3edb965-904e-4c4a-a96a-ec7cd581998e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:27 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300" returned: 0 in 0.493s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:27 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:27 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:27 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d Jul 21 08:16:27 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:27 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.538s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f731046-6395-4546-81e6-2d737c1d80f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87189d0-f027-41cb-95c1-f4308a4021e4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:27 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d" returned: 0 in 0.561s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:27 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:27 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:27 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d Jul 21 08:16:27 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:27 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.474s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:27 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300.7b926515-3d6e-418e-878f-a2f1b6c6df7d" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:27 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 Jul 21 08:16:27 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-7b926515-3d6e-418e-878f-a2f1b6c6df7d" released by "_delete_snapshot" :: held 2.206s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" released by "delete_snapshot" :: held 2.247s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:28 devstack cinder-volume[87372]: WARNING cinder.quota [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-776279667 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-776279667, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:16:28 devstack cinder-volume[87372]: WARNING cinder.quota [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-776279667 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-776279667, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:16:28 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] Created reservations ['2864daa1-8c59-4089-a1de-bf8759a4348e', '87e9b1e6-0fda-4ff3-97d7-af96498c6e45', 'ee30e3ee-054e-47ad-b7f5-2a0e15b3e78d', '44da2e21-c7c9-4bd1-9171-203e850dc036'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-44029490-b8cf-43e4-81f3-cd0d677c8843 tempest-GroupSnapshotsV319Test-1916227258 None] group_snapshot b5c0c37e-74f1-4765-a122-edc5f88ec5b7: deleted successfully Jul 21 08:16:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" acquired by "delete_volume" :: waited 0.046s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:30 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[084156dd-f838-49c1-a349-2640562f3bc2]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:30 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 Jul 21 08:16:30 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:31 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300" returned: 0 in 0.899s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:31 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300 Jul 21 08:16:31 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:31 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-914a90cf-d7d7-46df-a67d-4f2282cb9300" returned: 0 in 0.787s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "cinder-quobyte-914a90cf-d7d7-46df-a67d-4f2282cb9300" released by "delete_volume" :: held 1.867s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Created reservations ['fd9600fe-add5-4a77-8410-f1b303a1a3b1'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:32 devstack cinder-volume[87372]: WARNING cinder.quota [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-776279667 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-776279667, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Created reservations ['2ffa6e65-76df-454f-883c-804bbfa747ac', 'c807fc7f-d8da-4a45-9f58-1a1b3402294b', '7e1ebf63-772d-4b07-906d-fbf62fed2f28', 'b50af7ea-c1a4-464e-94c9-c19f72d03b95'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:32 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:32 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:32 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.493s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:32 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-93f52b11-e950-41d6-812b-e2a8aeacec61 tempest-GroupSnapshotsV319Test-1916227258 None] Delete group completed successfully. Jul 21 08:16:34 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" returned: 0 in 6.225s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f9d74-c74e-45de-ba43-35e4840badbc]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:34 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:34 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:34 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.770s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:16:34 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Converted 1024.00 MB image at 164.43 MB/s Jul 21 08:16:34 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 is being set with open permissions: ugo+rw Jul 21 08:16:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:34 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 Jul 21 08:16:34 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:35 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" released by "_copy_volume_from_snapshot" :: held 8.412s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-f5859fb5-164b-48b9-b8dd-0944a4bd7f57" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-f5859fb5-164b-48b9-b8dd-0944a4bd7f57" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Deleting offline snapshot f5859fb5-164b-48b9-b8dd-0944a4bd7f57 of volume 7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] snapshot_file for this snap is: volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8469a2f-b666-45c9-80bd-ae725cedff9b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:35 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:35 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:35 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.500s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f731046-6395-4546-81e6-2d737c1d80f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226cecd-2d03-4e67-8a8a-fcdb6f3eb389]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:36 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:36 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:36 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.509s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:36 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:36 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:37 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.735s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:37 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57 Jul 21 08:16:37 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:37 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8.f5859fb5-164b-48b9-b8dd-0944a4bd7f57" returned: 0 in 0.439s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-f5859fb5-164b-48b9-b8dd-0944a4bd7f57" released by "_delete_snapshot" :: held 2.313s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.823s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ea7906-e2f1-459d-8c27-f21efbb74258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2', 'volume_size': 1, 'source_volid': '7f731046-6395-4546-81e6-2d737c1d80f8', 'source_volstatus': 'available'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cb7298-590d-4313-97dd-ab61e48b097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Volume volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 (8ec252fb-059e-42e8-8a3b-ce9e4d5784d2): created successfully Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cb7298-590d-4313-97dd-ab61e48b097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (6ffe842c-eba6-484d-b02e-343cbc796765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cc6d7249-d709-4be1-81f7-4db903f95f5e tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Flow 'volume_create_manager' (ff8dfb1e-70b3-4dbc-b26f-974d20729fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03bd6ac-46ac-4901-a46f-1fc06ef9b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03bd6ac-46ac-4901-a46f-1fc06ef9b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1773628529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcabc91b-1932-4f7d-86cf-0b0df415510c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f5452ac4c44cf4b1a4f0707d2363af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:39Z,use_quota=True,user_id='1f314bcd6df04ac182efb4a5e452b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d435a7-5c71-48b9-903a-a8be81298f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d435a7-5c71-48b9-903a-a8be81298f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5195632-35ca-42db-ac87-9cde093ca50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5195632-35ca-42db-ac87-9cde093ca50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcabc91b-1932-4f7d-86cf-0b0df415510c', 'volume_name': 'volume-bcabc91b-1932-4f7d-86cf-0b0df415510c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e75b9-a179-4ceb-a0a9-01524a328c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35e75b9-a179-4ceb-a0a9-01524a328c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d28433-5b78-42ce-ad38-bff50855a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Volume bcabc91b-1932-4f7d-86cf-0b0df415510c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcabc91b-1932-4f7d-86cf-0b0df415510c', 'volume_size': 1} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1773628529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcabc91b-1932-4f7d-86cf-0b0df415510c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f5452ac4c44cf4b1a4f0707d2363af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:39Z,use_quota=True,user_id='1f314bcd6df04ac182efb4a5e452b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Creating volume bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:38 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:39 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c 1073741824 Jul 21 08:16:39 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:39 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c 1073741824" returned: 0 in 0.739s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:39 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:16:39 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (9ef83b34-46a7-4705-a393-1e15a5263d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c25769c-e87b-47ea-875b-a93e78f9292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c25769c-e87b-47ea-875b-a93e78f9292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1717416875',display_name='tempest-VolumesGetTest-Volume-334382228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9502eb96-3f42-4da4-9e2b-b0e5a8217aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:40Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeda871-1d8c-44bd-9524-be9cf46f0377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeda871-1d8c-44bd-9524-be9cf46f0377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e393cc-5aae-4b83-bc09-f476730d6e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e393cc-5aae-4b83-bc09-f476730d6e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9502eb96-3f42-4da4-9e2b-b0e5a8217aee', 'volume_name': 'volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07bd276-7a5d-4f14-bce8-fc446743bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07bd276-7a5d-4f14-bce8-fc446743bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eeb149-05f5-4dcd-a4df-5f236420d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Volume 9502eb96-3f42-4da4-9e2b-b0e5a8217aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee', 'volume_size': 1} Jul 21 08:16:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:40 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1717416875',display_name='tempest-VolumesGetTest-Volume-334382228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9502eb96-3f42-4da4-9e2b-b0e5a8217aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:40Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Creating volume 9502eb96-3f42-4da4-9e2b-b0e5a8217aee {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:40 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d28433-5b78-42ce-ad38-bff50855a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcabc91b-1932-4f7d-86cf-0b0df415510c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e23752-2535-42d7-b72d-213797461497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:40 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee 1073741824 Jul 21 08:16:40 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Volume volume-bcabc91b-1932-4f7d-86cf-0b0df415510c (bcabc91b-1932-4f7d-86cf-0b0df415510c): created successfully Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e23752-2535-42d7-b72d-213797461497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Flow 'volume_create_manager' (ff8dfb1e-70b3-4dbc-b26f-974d20729fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d7e182a0-8414-4f45-b301-41afe991e89b tempest-TestStampPattern-1131871713 None] Created volume successfully. Jul 21 08:16:40 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee 1073741824" returned: 0 in 0.644s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:40 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee Jul 21 08:16:40 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:41 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eeb149-05f5-4dcd-a4df-5f236420d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa64a5-21c9-4f2d-96b8-9df249958be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Volume volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee (9502eb96-3f42-4da4-9e2b-b0e5a8217aee): created successfully Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa64a5-21c9-4f2d-96b8-9df249958be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (9ef83b34-46a7-4705-a393-1e15a5263d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7625f204-c8ac-498c-958f-086c49bb4bf9 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-9502eb96-3f42-4da4-9e2b-b0e5a8217aee-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "cinder-9502eb96-3f42-4da4-9e2b-b0e5a8217aee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4325f1c1-d981-41d7-9e8c-c316a0bf2291]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:42 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee Jul 21 08:16:42 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:42 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" returned: 0 in 0.636s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:42 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee Jul 21 08:16:42 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:43 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" returned: 0 in 0.340s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-9502eb96-3f42-4da4-9e2b-b0e5a8217aee" released by "delete_volume" :: held 1.074s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Created reservations ['d35c4eba-a06b-4f08-82f3-089ad61561c9', '808d5c80-f17e-4f5f-adb9-2b05182535c1', '352023ca-d477-49c3-a555-db3e3bc73a21', '31591c31-70e1-4fd8-87a6-0b6f8d2c895c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:43 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:43 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:43 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:16:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-603fe6c9-7f0b-4f2c-89e4-caf3bbed9956 tempest-VolumesGetTest-2141948707 None] Lock "cinder-9502eb96-3f42-4da4-9e2b-b0e5a8217aee-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "cinder-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5b8eb2-1f16-4dfe-aad6-fa97d11b173d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:44 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 Jul 21 08:16:44 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:45 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" returned: 0 in 0.500s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:45 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2 Jul 21 08:16:45 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:45 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" returned: 0 in 0.374s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2" released by "delete_volume" :: held 0.939s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Created reservations ['fbc8f5b3-e134-4c6a-aab4-0225c681299e', '835fc8bc-99d5-4dbb-981e-504aa1079c49', 'b6bde377-bb91-458d-970e-56997b71c9c6', '255f9cde-27ed-43b2-8408-4db8d60906b3'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:45 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:45 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:46 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.456s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:46 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:46 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:16:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bb55f3b0-25cd-4c21-910f-29a19b08fc62 tempest-VolumesGetTest-2141948707 None] Lock "cinder-8ec252fb-059e-42e8-8a3b-ce9e4d5784d2-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-7f731046-6395-4546-81e6-2d737c1d80f8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "cinder-7f731046-6395-4546-81e6-2d737c1d80f8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-7f731046-6395-4546-81e6-2d737c1d80f8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-7f731046-6395-4546-81e6-2d737c1d80f8" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec5293-2495-413a-857e-9386616f7a9f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:47 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:47 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:48 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.812s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:48 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8 Jul 21 08:16:48 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:48 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7f731046-6395-4546-81e6-2d737c1d80f8" returned: 0 in 0.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-7f731046-6395-4546-81e6-2d737c1d80f8" released by "delete_volume" :: held 1.428s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Created reservations ['1d0382ec-ac45-4b61-9c8e-1d21c568520f', 'af4e770d-76f8-40d5-a0eb-e5ae64884ec0', '4bb823c8-4f7b-41b2-90f9-32cf1c42c4b8', '39b90e3b-f77e-40cc-a133-6a69ffb724e7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:48 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:48 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:49 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.543s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:49 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:16:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d637d844-57f6-4e7b-bc93-f8d6ebc46515 tempest-VolumesGetTest-2141948707 None] Lock "cinder-7f731046-6395-4546-81e6-2d737c1d80f8-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (5880d6ca-cb2b-4497-8f97-0a424010ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e288e7-1a6a-4274-86ea-259766a46bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e288e7-1a6a-4274-86ea-259766a46bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-541778609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adf1a51-8dbe-48cf-8307-eb6cd44271d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:52Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c67bf25-51b2-4398-9bdf-6589702ed4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c67bf25-51b2-4398-9bdf-6589702ed4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5622ffe0-2c99-4b6c-b476-fe7a9e523b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:51 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5622ffe0-2c99-4b6c-b476-fe7a9e523b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2adf1a51-8dbe-48cf-8307-eb6cd44271d0', 'volume_name': 'volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c4a094-b092-4d58-a241-638c47481b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c4a094-b092-4d58-a241-638c47481b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067b5f60-8fea-44ca-9e99-4efc1dc3fe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:16:52 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Trying to clone 2adf1a51-8dbe-48cf-8307-eb6cd44271d0 from image a3f8b652-69e7-49da-931e-22bcdb879c31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:52 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:16:52 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:16:53 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Image download 20.69 MB at 20.69 MB/s Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[769706a0-6b61-41f3-a2ee-4236e0541a37]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:53 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.811s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:16:53 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD Jul 21 08:16:53 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:53 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:53 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 is fetched for user f1a41c1dc3ee49958b89ebcf9e002f8d. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e20831b-e639-460b-a8ed-4f8f0cbe4494]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:54 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD Jul 21 08:16:54 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:54 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-541778609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adf1a51-8dbe-48cf-8307-eb6cd44271d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:16:52Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Creating volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:16:54 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:16:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:54 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1073741824 Jul 21 08:16:54 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:55 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1073741824" returned: 0 in 0.926s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:55 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 Jul 21 08:16:55 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:56 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" returned: 0 in 0.712s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Attempting download of a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb730be-5720-4dda-a96b-7b9848d79b07]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:56 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9 Jul 21 08:16:56 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:57 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9" returned: 0 in 0.629s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:57 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9 Jul 21 08:16:57 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:57 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9" returned: 1 in 0.775s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_kbuil6m9' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1236765-0081-4556-b79b-502b434325e8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:16:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:58 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD Jul 21 08:16:58 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:16:58 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 21 08:16:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:16:58 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] a3f8b652-69e7-49da-931e-22bcdb879c31 was qcow2, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:16:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:16:58 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 Jul 21 08:16:58 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:01 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" returned: 0 in 2.998s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:01 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_aqc7hsufdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:17:01 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Converted 112.00 MB image at 37.35 MB/s Jul 21 08:17:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:01 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1G Jul 21 08:17:01 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:02 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 1G" returned: 0 in 0.421s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Downloaded image a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 for user f1a41c1dc3ee49958b89ebcf9e002f8d is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Marking volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Copying metadata from image a3f8b652-69e7-49da-931e-22bcdb879c31 to 2adf1a51-8dbe-48cf-8307-eb6cd44271d0. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Creating volume glance metadata for volume 2adf1a51-8dbe-48cf-8307-eb6cd44271d0 backed by image a3f8b652-69e7-49da-931e-22bcdb879c31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067b5f60-8fea-44ca-9e99-4efc1dc3fe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bc171a-f871-4dd7-a0c3-f60cfcc71716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:02 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Volume volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 (2adf1a51-8dbe-48cf-8307-eb6cd44271d0): created successfully Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bc171a-f871-4dd7-a0c3-f60cfcc71716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (5880d6ca-cb2b-4497-8f97-0a424010ee85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-130c822d-4440-446c-a0ba-ae2c796d4f02 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:17:03 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (14c41a4f-3f1f-4133-97c5-1a6733c047be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c4547c-4c96-4b1a-a6bb-178c996ac99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c4547c-4c96-4b1a-a6bb-178c996ac99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1871758965',display_name='tempest-VolumesGetTest-Volume-356930608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94657239-cbc0-4db0-b093-16ae796b51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:04Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea576bc-5667-4fbc-84aa-1e81748fd692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea576bc-5667-4fbc-84aa-1e81748fd692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d4ce2c-5066-4f0b-b3bd-729d81b02f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d4ce2c-5066-4f0b-b3bd-729d81b02f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94657239-cbc0-4db0-b093-16ae796b51bd', 'volume_name': 'volume-94657239-cbc0-4db0-b093-16ae796b51bd', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8987a49e-7b95-488a-ad49-9b711b689cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8987a49e-7b95-488a-ad49-9b711b689cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e035f7f-bd84-456a-9458-c7228e548dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Volume 94657239-cbc0-4db0-b093-16ae796b51bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94657239-cbc0-4db0-b093-16ae796b51bd', 'volume_size': 1} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1871758965',display_name='tempest-VolumesGetTest-Volume-356930608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94657239-cbc0-4db0-b093-16ae796b51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27f753c1c2b442a90488b79a66cbfca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:04Z,use_quota=True,user_id='f1a41c1dc3ee49958b89ebcf9e002f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Creating volume 94657239-cbc0-4db0-b093-16ae796b51bd {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:04 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:04 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd 1073741824 Jul 21 08:17:04 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:04 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd 1073741824" returned: 0 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:04 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd Jul 21 08:17:04 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:04 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd" returned: 0 in 0.249s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e035f7f-bd84-456a-9458-c7228e548dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94657239-cbc0-4db0-b093-16ae796b51bd', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a0c1b4-d812-4934-b6ed-895947a36913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:04 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Volume volume-94657239-cbc0-4db0-b093-16ae796b51bd (94657239-cbc0-4db0-b093-16ae796b51bd): created successfully Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a0c1b4-d812-4934-b6ed-895947a36913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Flow 'volume_create_manager' (14c41a4f-3f1f-4133-97c5-1a6733c047be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:04 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cfddefac-978e-413b-809d-c787a9e1ad20 tempest-VolumesGetTest-2141948707 None] Created volume successfully. Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-94657239-cbc0-4db0-b093-16ae796b51bd-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "cinder-94657239-cbc0-4db0-b093-16ae796b51bd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-94657239-cbc0-4db0-b093-16ae796b51bd" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-94657239-cbc0-4db0-b093-16ae796b51bd" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7461c9-fcfe-4216-8068-3b72c03bc421]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:06 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd Jul 21 08:17:06 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:07 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd" returned: 0 in 0.562s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:07 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd Jul 21 08:17:07 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:07 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-94657239-cbc0-4db0-b093-16ae796b51bd" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-94657239-cbc0-4db0-b093-16ae796b51bd" released by "delete_volume" :: held 1.095s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Created reservations ['33c7cc5e-e6b6-4f8d-947b-e6855a926d1a', 'e8cbdbb9-3101-457e-9d94-103305b4903d', 'd20a600d-61b0-48f9-8408-6e4e45551007', '79984390-a5cb-492e-8c84-f1e04839c99f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:07 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:07 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:07 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:07 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3025ff99-14b3-4e9b-8c88-e120f577845c tempest-VolumesGetTest-2141948707 None] Lock "cinder-94657239-cbc0-4db0-b093-16ae796b51bd-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-2adf1a51-8dbe-48cf-8307-eb6cd44271d0-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "cinder-2adf1a51-8dbe-48cf-8307-eb6cd44271d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Acquiring lock "cinder-quobyte-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6815f37f-3e0c-4c1f-bd10-4899bf39afb5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:08 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 Jul 21 08:17:08 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:09 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" returned: 0 in 0.398s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:09 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0 Jul 21 08:17:09 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:09 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" returned: 0 in 0.259s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "cinder-quobyte-2adf1a51-8dbe-48cf-8307-eb6cd44271d0" released by "delete_volume" :: held 0.702s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Created reservations ['745e4328-6fb1-4b0a-8ec4-1fda30e41aca', '59dbdf9d-0536-4562-ac9c-9a4955e2b0e7', '3dee4aae-529b-4530-899a-69dcccf60166', '369b54d6-a498-420f-b3ad-a054e7014f3d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:09 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:09 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:09 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Deleted volume successfully. Jul 21 08:17:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-520416af-0e75-4c65-9f76-fbc66d8eb795 tempest-VolumesGetTest-2141948707 None] Lock "cinder-2adf1a51-8dbe-48cf-8307-eb6cd44271d0-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:12 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (123e514c-2d8e-4232-98f9-d0e68d1f39a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65eda0-87ad-44d4-ad15-71dffebf4fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c65eda0-87ad-44d4-ad15-71dffebf4fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1727815826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a40a06-2156-4de5-bace-87cb5bce701d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:13Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89621df-14a4-4e7f-b188-1be36f64c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89621df-14a4-4e7f-b188-1be36f64c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a85f03-8341-44a6-a45d-ac73b0ace56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a85f03-8341-44a6-a45d-ac73b0ace56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a40a06-2156-4de5-bace-87cb5bce701d', 'volume_name': 'volume-15a40a06-2156-4de5-bace-87cb5bce701d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00ebccd-2143-4efd-8d8c-e0e7dc6b6ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00ebccd-2143-4efd-8d8c-e0e7dc6b6ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aaee27-24b9-4655-a5fb-9cc2e4ecd176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Volume 15a40a06-2156-4de5-bace-87cb5bce701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a40a06-2156-4de5-bace-87cb5bce701d', 'volume_size': 1} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1727815826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a40a06-2156-4de5-bace-87cb5bce701d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:13Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Creating volume 15a40a06-2156-4de5-bace-87cb5bce701d {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:13 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d 1073741824 Jul 21 08:17:13 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:13 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d 1073741824" returned: 0 in 0.439s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:13 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d Jul 21 08:17:13 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:13 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d" returned: 0 in 0.262s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3aaee27-24b9-4655-a5fb-9cc2e4ecd176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a40a06-2156-4de5-bace-87cb5bce701d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5050d2e-100f-4a07-b659-fb511332f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Volume volume-15a40a06-2156-4de5-bace-87cb5bce701d (15a40a06-2156-4de5-bace-87cb5bce701d): created successfully Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5050d2e-100f-4a07-b659-fb511332f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (123e514c-2d8e-4232-98f9-d0e68d1f39a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7b3186b9-5279-46d2-973e-e47f3bbba39c tempest-VolumesListTestJSON-1252399616 None] Created volume successfully. Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=81,cinder:UPDATE=94,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (ca8bb95b-1070-4026-84ec-9aee5fdc42d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9a54e6-c9e7-487a-a20f-b2e79d90fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9a54e6-c9e7-487a-a20f-b2e79d90fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1641827714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03b1de-ab18-4c5e-86f7-549a56e700bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:15Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da57a16-79a9-42c0-a1c7-55bd758c692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da57a16-79a9-42c0-a1c7-55bd758c692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7000fea1-79fc-4fd6-9b09-66fc410e21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7000fea1-79fc-4fd6-9b09-66fc410e21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e03b1de-ab18-4c5e-86f7-549a56e700bc', 'volume_name': 'volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c2d2ba-6561-4937-b186-0e2cb5dedb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c2d2ba-6561-4937-b186-0e2cb5dedb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d34243-b77a-4f91-a71b-a500db032c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Volume 6e03b1de-ab18-4c5e-86f7-549a56e700bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc', 'volume_size': 1} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1641827714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03b1de-ab18-4c5e-86f7-549a56e700bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:15Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Creating volume 6e03b1de-ab18-4c5e-86f7-549a56e700bc {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:14 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:14 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc 1073741824 Jul 21 08:17:14 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3486632c-98c5-4c90-8baf-2fe7da4cc03e req-9f09db70-3a77-4762-9ac6-f07fd8d29699 tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:15 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc 1073741824" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:15 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc Jul 21 08:17:15 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:15 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3486632c-98c5-4c90-8baf-2fe7da4cc03e req-9f09db70-3a77-4762-9ac6-f07fd8d29699 tempest-TestStampPattern-1131871713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.623s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3486632c-98c5-4c90-8baf-2fe7da4cc03e req-9f09db70-3a77-4762-9ac6-f07fd8d29699 tempest-TestStampPattern-1131871713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d34243-b77a-4f91-a71b-a500db032c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e164a2-966d-4411-b3f7-a515552010e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:15 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Volume volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc (6e03b1de-ab18-4c5e-86f7-549a56e700bc): created successfully Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e164a2-966d-4411-b3f7-a515552010e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (ca8bb95b-1070-4026-84ec-9aee5fdc42d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-3486632c-98c5-4c90-8baf-2fe7da4cc03e req-9f09db70-3a77-4762-9ac6-f07fd8d29699 tempest-TestStampPattern-1131871713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-bcabc91b-1932-4f7d-86cf-0b0df415510c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65a373ed-e6f2-448a-8a19-8d04ca3e921a', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:17:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-63996934-05ba-49f1-a815-b0c063f24cd3 tempest-VolumesListTestJSON-1252399616 None] Created volume successfully. Jul 21 08:17:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-3486632c-98c5-4c90-8baf-2fe7da4cc03e req-9f09db70-3a77-4762-9ac6-f07fd8d29699 tempest-TestStampPattern-1131871713 None] attachment_update completed successfully. Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:INSERT=30,cinder:UPDATE=117,cinder:SELECT=95,cinder:DELETE=9 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (4be46840-eea8-493d-b5ff-45b5445d9a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f23471-ef3a-469c-8180-32460af40660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f23471-ef3a-469c-8180-32460af40660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-147046384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5ead00-16ef-47e2-9ef0-931d74894531,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:17Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3301c8-d318-4c23-b98b-8ad527f710ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3301c8-d318-4c23-b98b-8ad527f710ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ea263e-ee74-4944-9e14-e16955689888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ea263e-ee74-4944-9e14-e16955689888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5ead00-16ef-47e2-9ef0-931d74894531', 'volume_name': 'volume-6e5ead00-16ef-47e2-9ef0-931d74894531', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b6f6c9-50b8-4f3b-b940-cafac1695fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b6f6c9-50b8-4f3b-b940-cafac1695fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc6db7-c7b6-48c1-9470-94bdac9ac4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Volume 6e5ead00-16ef-47e2-9ef0-931d74894531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5ead00-16ef-47e2-9ef0-931d74894531', 'volume_size': 1} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-147046384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5ead00-16ef-47e2-9ef0-931d74894531,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2c0c8996122a4341ac9f937c6b938c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:17Z,use_quota=True,user_id='b0d08b59869848c28d1168856d336ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Creating volume 6e5ead00-16ef-47e2-9ef0-931d74894531 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:17 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:17 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 1073741824 Jul 21 08:17:17 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:17 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 1073741824" returned: 0 in 0.551s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:18 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 Jul 21 08:17:18 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:18 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531" returned: 0 in 0.377s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc6db7-c7b6-48c1-9470-94bdac9ac4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5ead00-16ef-47e2-9ef0-931d74894531', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0140021-30ba-4af3-ba77-3d0b9f733815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:18 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Volume volume-6e5ead00-16ef-47e2-9ef0-931d74894531 (6e5ead00-16ef-47e2-9ef0-931d74894531): created successfully Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0140021-30ba-4af3-ba77-3d0b9f733815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Flow 'volume_create_manager' (4be46840-eea8-493d-b5ff-45b5445d9a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2876b63f-5e6a-496d-b595-1cde7e0b5e0e tempest-VolumesListTestJSON-1252399616 None] Created volume successfully. Jul 21 08:17:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-9f11486f-4275-482e-bce8-6a9c54cb4191 req-0567025b-0dbc-4072-af37-5f8508c0b6c7 tempest-TestStampPattern-1131871713 None] Terminate volume connection completed successfully. Jul 21 08:17:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-9f11486f-4275-482e-bce8-6a9c54cb4191 req-0567025b-0dbc-4072-af37-5f8508c0b6c7 tempest-TestStampPattern-1131871713 None] Deleting attachment 65a373ed-e6f2-448a-8a19-8d04ca3e921a. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (e1e4d734-096d-48b3-b663-18f21a250b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c168c7f-727a-4370-9335-77331affa88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c168c7f-727a-4370-9335-77331affa88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-201948509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2438be11-3fcb-477a-be4a-3c093daa84b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:21Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e6ca69-7866-40e1-9e08-316f1f581fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e6ca69-7866-40e1-9e08-316f1f581fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7b1ef-c17f-45a6-85f7-7647cb85d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c7b1ef-c17f-45a6-85f7-7647cb85d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2438be11-3fcb-477a-be4a-3c093daa84b1', 'volume_name': 'volume-2438be11-3fcb-477a-be4a-3c093daa84b1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba102b0-6706-4803-af0b-5e429d5f3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba102b0-6706-4803-af0b-5e429d5f3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2935c37-0afc-43c3-8117-3427582cb391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Volume 2438be11-3fcb-477a-be4a-3c093daa84b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2438be11-3fcb-477a-be4a-3c093daa84b1', 'volume_size': 1} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-201948509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2438be11-3fcb-477a-be4a-3c093daa84b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:21Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Creating volume 2438be11-3fcb-477a-be4a-3c093daa84b1 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:21 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 1073741824 Jul 21 08:17:21 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-6e5ead00-16ef-47e2-9ef0-931d74894531-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-6e5ead00-16ef-47e2-9ef0-931d74894531-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-quobyte-6e5ead00-16ef-47e2-9ef0-931d74894531" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-6e5ead00-16ef-47e2-9ef0-931d74894531" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:22 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 1073741824" returned: 0 in 0.640s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b1789-d491-41fa-836c-ec7319c92ecd]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:22 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 Jul 21 08:17:22 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:22 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 Jul 21 08:17:22 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:22 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Creating offline snapshot 116510ca-7950-4f63-9a7c-0dd78d2e577c of volume bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2935c37-0afc-43c3-8117-3427582cb391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2438be11-3fcb-477a-be4a-3c093daa84b1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9de3b0b-0000-41c2-8f07-181b656f9fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6725c7a-83c2-449e-8300-c6f4c92f8e7d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:22 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Volume volume-2438be11-3fcb-477a-be4a-3c093daa84b1 (2438be11-3fcb-477a-be4a-3c093daa84b1): created successfully Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9de3b0b-0000-41c2-8f07-181b656f9fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (e1e4d734-096d-48b3-b663-18f21a250b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:22 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531" returned: 0 in 0.398s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-495acef3-ff59-4fb9-888a-a9c0d31df40b tempest-AttachVolumeTestJSON-595923900 None] Created volume successfully. Jul 21 08:17:22 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531 Jul 21 08:17:22 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:22 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:17:22 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:23 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e5ead00-16ef-47e2-9ef0-931d74894531" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-6e5ead00-16ef-47e2-9ef0-931d74894531" released by "delete_volume" :: held 0.729s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Created reservations ['08e709b0-5e2c-4be1-97be-3c01c4bff344', 'a36d2905-8bfd-4be1-bab1-63bbf9448b91', '62c34f59-2306-432f-8f05-80239fdfda6e', '727943a0-fb3d-4de2-ae85-f7677f9bead2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:23 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.413s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:23 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c 1G Jul 21 08:17:23 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:23 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:23 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:23 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.309s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-6e03b1de-ab18-4c5e-86f7-549a56e700bc-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Deleted volume successfully. Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7dd4b5d4-f23d-4225-bd9e-8b41bdcc97c8 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-6e5ead00-16ef-47e2-9ef0-931d74894531-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-6e03b1de-ab18-4c5e-86f7-549a56e700bc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-quobyte-6e03b1de-ab18-4c5e-86f7-549a56e700bc" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-6e03b1de-ab18-4c5e-86f7-549a56e700bc" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:23 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e36e14-4f90-495c-9f56-c5c3b12cc360]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c 1G" returned: 0 in 0.558s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcabc91b-1932-4f7d-86cf-0b0df415510c -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:23 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcabc91b-1932-4f7d-86cf-0b0df415510c -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:17:23 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:23 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc Jul 21 08:17:23 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:23 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcabc91b-1932-4f7d-86cf-0b0df415510c -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.338s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c is being set with open permissions: ugo+rw Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:24 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:17:24 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:24 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc" returned: 0 in 0.573s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:24 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc Jul 21 08:17:24 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:24 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:24 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info Jul 21 08:17:24 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-bbed88da-6e67-4e83-a9e3-d4a5b58eda8e req-c18342d3-9462-4a46-8ad9-6e7a7aad9371 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:24 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6e03b1de-ab18-4c5e-86f7-549a56e700bc" returned: 0 in 0.363s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-6e03b1de-ab18-4c5e-86f7-549a56e700bc" released by "delete_volume" :: held 0.993s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Created reservations ['acb0c60a-9508-458a-a64e-511d2c4dbd8d', '7fe6f414-235d-4606-a6fd-7c4439350e6e', '42077b19-f0c2-4eca-b5b2-bb98381241c6', 'c39ae7af-57bb-4e71-a1b4-1b75e7121240'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:24 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:24 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:24 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info" returned: 0 in 0.303s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info is being set with open permissions: ugo+rw Jul 21 08:17:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:24 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info Jul 21 08:17:24 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:25 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Deleted volume successfully. Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e5c5373f-898a-4c72-aedb-bd2817958665 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-6e03b1de-ab18-4c5e-86f7-549a56e700bc-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:25 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.info" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-bbed88da-6e67-4e83-a9e3-d4a5b58eda8e req-c18342d3-9462-4a46-8ad9-6e7a7aad9371 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.527s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-bbed88da-6e67-4e83-a9e3-d4a5b58eda8e req-c18342d3-9462-4a46-8ad9-6e7a7aad9371 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3006a640-732b-43fe-9414-16899ff16a54 tempest-TestStampPattern-1131871713 None] Create snapshot completed successfully Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-bbed88da-6e67-4e83-a9e3-d4a5b58eda8e req-c18342d3-9462-4a46-8ad9-6e7a7aad9371 tempest-AttachVolumeTestJSON-595923900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-2438be11-3fcb-477a-be4a-3c093daa84b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f2f2fc7-5545-433c-9a90-752867d94662', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:17:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-bbed88da-6e67-4e83-a9e3-d4a5b58eda8e req-c18342d3-9462-4a46-8ad9-6e7a7aad9371 tempest-AttachVolumeTestJSON-595923900 None] attachment_update completed successfully. Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-15a40a06-2156-4de5-bace-87cb5bce701d-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-15a40a06-2156-4de5-bace-87cb5bce701d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "cinder-quobyte-15a40a06-2156-4de5-bace-87cb5bce701d" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-15a40a06-2156-4de5-bace-87cb5bce701d" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4024c-5b13-467b-95fa-9ffc58e959ec]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:25 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d Jul 21 08:17:25 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Flow 'volume_create_manager' (2e74216c-c25e-4101-b067-ea606be4ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fafb5ca-3f20-4746-816c-285691f0608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fafb5ca-3f20-4746-816c-285691f0608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-545525746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60974d8a-4710-4189-acbb-aef8fc790bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c913295f5e42eeaed112ee5e2615f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:26Z,use_quota=True,user_id='c5d4edb777f2430c8e448b86dc54bf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6f34e1-8710-498a-a748-f173ca5cbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6f34e1-8710-498a-a748-f173ca5cbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd249a25-cb8c-4ec1-88cb-2c4405095892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd249a25-cb8c-4ec1-88cb-2c4405095892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60974d8a-4710-4189-acbb-aef8fc790bb2', 'volume_name': 'volume-60974d8a-4710-4189-acbb-aef8fc790bb2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d36edc-b238-42b1-89c8-f8e5b171adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d36edc-b238-42b1-89c8-f8e5b171adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e7b68-c3b8-484e-b7a1-b92cb66679a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Volume 60974d8a-4710-4189-acbb-aef8fc790bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60974d8a-4710-4189-acbb-aef8fc790bb2', 'volume_size': 1} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-545525746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60974d8a-4710-4189-acbb-aef8fc790bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85c913295f5e42eeaed112ee5e2615f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:26Z,use_quota=True,user_id='c5d4edb777f2430c8e448b86dc54bf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Creating volume 60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:25 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:25 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 1073741824 Jul 21 08:17:25 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:26 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d" returned: 0 in 0.472s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:26 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d Jul 21 08:17:26 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:26 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-15a40a06-2156-4de5-bace-87cb5bce701d" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:26 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-quobyte-15a40a06-2156-4de5-bace-87cb5bce701d" released by "delete_volume" :: held 0.867s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 1073741824" returned: 0 in 0.528s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:26 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 Jul 21 08:17:26 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Created reservations ['cb21bbce-11ed-470b-93d0-7cd4571414ad', '58982b42-5028-49e3-8949-66719fe523b5', '0746a58b-6335-4eee-9fac-c6724f17f166', '30c510eb-05b8-45b6-957c-cb9968a82458'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:26 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:26 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:26 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e7b68-c3b8-484e-b7a1-b92cb66679a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60974d8a-4710-4189-acbb-aef8fc790bb2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a09cde-41c8-49b1-a171-8a9453ba5a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Volume volume-60974d8a-4710-4189-acbb-aef8fc790bb2 (60974d8a-4710-4189-acbb-aef8fc790bb2): created successfully Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a09cde-41c8-49b1-a171-8a9453ba5a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Flow 'volume_create_manager' (2e74216c-c25e-4101-b067-ea606be4ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1c30b24c-2b6a-4e91-8cdc-8daa0d94c2e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Created volume successfully. Jul 21 08:17:26 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.370s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Deleted volume successfully. Jul 21 08:17:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-90637961-a277-46f0-80f8-5e9c84db3d80 tempest-VolumesListTestJSON-1252399616 None] Lock "cinder-15a40a06-2156-4de5-bace-87cb5bce701d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (a3592f54-b95b-498e-8ad0-a5ddbf4d520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f829406b-40dc-4124-9c4f-7146d66b4a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f829406b-40dc-4124-9c4f-7146d66b4a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218498957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816c91a-116b-49ee-9bd4-f24904ffdeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:27Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aece5d3-833e-483d-9c5e-1fcabc9aa238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aece5d3-833e-483d-9c5e-1fcabc9aa238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5c9d5d-ed2d-4f4b-bcd1-f069f9bef525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5c9d5d-ed2d-4f4b-bcd1-f069f9bef525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e816c91a-116b-49ee-9bd4-f24904ffdeb6', 'volume_name': 'volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62492b-db96-4bab-93e3-f6cff0bfb9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62492b-db96-4bab-93e3-f6cff0bfb9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a15f52-0fae-4d66-a58b-8eb72cc15b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:27 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Volume e816c91a-116b-49ee-9bd4-f24904ffdeb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6', 'volume_size': 1} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218498957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816c91a-116b-49ee-9bd4-f24904ffdeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ac7295f03b44cfa34c1f3a8d43f93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:27Z,use_quota=True,user_id='7bfb60023bf14f96bef443554be3fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Creating volume e816c91a-116b-49ee-9bd4-f24904ffdeb6 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:27 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:17:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:27 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 1073741824 Jul 21 08:17:27 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:28 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 1073741824" returned: 0 in 0.550s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:28 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 Jul 21 08:17:28 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:28 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Creating offline snapshot 6618a29e-a7d2-47bb-b842-1afad364e402 of volume 60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a15f52-0fae-4d66-a58b-8eb72cc15b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdda1585-1836-4bea-beb8-41b9a1cc0536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[595851c0-bdea-45ee-a4b7-c28214f807c9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Volume volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 (e816c91a-116b-49ee-9bd4-f24904ffdeb6): created successfully Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdda1585-1836-4bea-beb8-41b9a1cc0536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Flow 'volume_create_manager' (a3592f54-b95b-498e-8ad0-a5ddbf4d520c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7d2621ca-5087-4d31-a8c5-11488123a002 tempest-AttachVolumeTestJSON-595923900 None] Created volume successfully. Jul 21 08:17:28 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 Jul 21 08:17:28 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:28 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:29 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 1G Jul 21 08:17:29 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:29 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 1G" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60974d8a-4710-4189-acbb-aef8fc790bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:29 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60974d8a-4710-4189-acbb-aef8fc790bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 Jul 21 08:17:29 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:29 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60974d8a-4710-4189-acbb-aef8fc790bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:30 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 is being set with open permissions: ugo+rw Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:30 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 Jul 21 08:17:30 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:30 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402" returned: 0 in 0.469s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:30 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info Jul 21 08:17:30 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-0edf73d2-d8dd-40ed-8ac9-d08a0b3b1d90 req-4b4b1c6c-2339-40fa-926f-9950e40e960a tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:30 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info" returned: 0 in 0.397s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:30 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info is being set with open permissions: ugo+rw Jul 21 08:17:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:30 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info Jul 21 08:17:30 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:31 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.info" returned: 0 in 0.333s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-0edf73d2-d8dd-40ed-8ac9-d08a0b3b1d90 req-4b4b1c6c-2339-40fa-926f-9950e40e960a tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.482s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-0edf73d2-d8dd-40ed-8ac9-d08a0b3b1d90 req-4b4b1c6c-2339-40fa-926f-9950e40e960a tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-efd62364-ab20-493d-b950-6f28584fd4b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Create snapshot completed successfully Jul 21 08:17:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-0edf73d2-d8dd-40ed-8ac9-d08a0b3b1d90 req-4b4b1c6c-2339-40fa-926f-9950e40e960a tempest-AttachVolumeTestJSON-595923900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c35d2256-3c9e-40a3-bf83-2cd36c99e337', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:17:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-0edf73d2-d8dd-40ed-8ac9-d08a0b3b1d90 req-4b4b1c6c-2339-40fa-926f-9950e40e960a tempest-AttachVolumeTestJSON-595923900 None] attachment_update completed successfully. Jul 21 08:17:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "cinder-6618a29e-a7d2-47bb-b842-1afad364e402-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-6618a29e-a7d2-47bb-b842-1afad364e402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "cinder-quobyte-6618a29e-a7d2-47bb-b842-1afad364e402" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-6618a29e-a7d2-47bb-b842-1afad364e402" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Deleting offline snapshot 6618a29e-a7d2-47bb-b842-1afad364e402 of volume 60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] snapshot_file for this snap is: volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b9bf32-d246-44d6-bb12-38246d343851]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:33 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 Jul 21 08:17:33 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:33 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60974d8a-4710-4189-acbb-aef8fc790bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d495bc5-63b9-49b5-ac71-90f3b4f2a797]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a758cebd-9809-4dbd-9e39-8c5f1e3a37ff req-333a82bc-1181-4afb-bd5e-ab624aca7d7a tempest-AttachVolumeTestJSON-595923900 None] Terminate volume connection completed successfully. Jul 21 08:17:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-a758cebd-9809-4dbd-9e39-8c5f1e3a37ff req-333a82bc-1181-4afb-bd5e-ab624aca7d7a tempest-AttachVolumeTestJSON-595923900 None] Deleting attachment 8f2f2fc7-5545-433c-9a90-752867d94662. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:17:33 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 Jul 21 08:17:33 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:34 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2" returned: 0 in 0.520s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:34 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 Jul 21 08:17:34 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Flow 'volume_create_manager' (af5c0fde-aa61-4f63-b50b-cd7d8497312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c5c8da-af86-4bbc-868b-644db46a180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c5c8da-af86-4bbc-868b-644db46a180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-661554955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e1603-b2ea-4717-832d-6e7c00f18af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f5452ac4c44cf4b1a4f0707d2363af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=116510ca-7950-4f63-9a7c-0dd78d2e577c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:17:34Z,use_quota=True,user_id='1f314bcd6df04ac182efb4a5e452b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7373c810-6ded-4d9b-8e1c-6f91ec3d9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7373c810-6ded-4d9b-8e1c-6f91ec3d9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2392ae-98b6-49cd-9f25-0ccb47f2988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2392ae-98b6-49cd-9f25-0ccb47f2988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb7e1603-b2ea-4717-832d-6e7c00f18af9', 'volume_name': 'volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9', 'volume_size': 1, 'snapshot_id': '116510ca-7950-4f63-9a7c-0dd78d2e577c'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f69378-5232-45dc-a2d6-155bbef32510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f69378-5232-45dc-a2d6-155bbef32510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874b899b-bfc3-4220-a523-09a3e7d3ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Volume cb7e1603-b2ea-4717-832d-6e7c00f18af9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9', 'volume_size': 1, 'snapshot_id': '116510ca-7950-4f63-9a7c-0dd78d2e577c'} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c-cb7e1603-b2ea-4717-832d-6e7c00f18af9" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c-cb7e1603-b2ea-4717-832d-6e7c00f18af9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Creating volume cb7e1603-b2ea-4717-832d-6e7c00f18af9 from snapshot 116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] snapshot: 116510ca-7950-4f63-9a7c-0dd78d2e577c, volume: cb7e1603-b2ea-4717-832d-6e7c00f18af9, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[89774f4d-68ef-4189-9edc-5ff6c89b4c93]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:34 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402" returned: 0 in 0.575s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:34 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402 Jul 21 08:17:34 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:34 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:17:34 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:35 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2.6618a29e-a7d2-47bb-b842-1afad364e402" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:35 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.620s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcabc91b-1932-4f7d-86cf-0b0df415510c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-6618a29e-a7d2-47bb-b842-1afad364e402" released by "_delete_snapshot" :: held 2.307s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" released by "delete_snapshot" :: held 2.371s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094c292-842e-40cd-a8d8-fc467039f630]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-0994f17b-6367-4167-bddc-56549002fbb1 req-73c4068d-fb23-4291-961a-7d3100f28a24 tempest-AttachVolumeTestJSON-595923900 None] Terminate volume connection completed successfully. Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-0994f17b-6367-4167-bddc-56549002fbb1 req-73c4068d-fb23-4291-961a-7d3100f28a24 tempest-AttachVolumeTestJSON-595923900 None] Deleting attachment c35d2256-3c9e-40a3-bf83-2cd36c99e337. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:17:35 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:17:35 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Created reservations ['a469cd75-5c26-4795-a911-cddf4ca95e4b', 'eb58f4a2-985c-4656-aa81-a8de5c730372', '57a34ffa-b75c-49be-bc10-90e2d63270ca', 'd7ecc9f0-5d40-4c82-9ee1-c01b18970ccb'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Delete snapshot completed successfully. Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b20b3432-a3b7-4917-b758-97f26624ff7f tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-6618a29e-a7d2-47bb-b842-1afad364e402-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:35 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:17:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:35 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 Jul 21 08:17:35 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "cinder-60974d8a-4710-4189-acbb-aef8fc790bb2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-60974d8a-4710-4189-acbb-aef8fc790bb2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[338124a1-f04a-4d2a-895c-30a0a4f833d6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:37 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 Jul 21 08:17:37 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:37 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2" returned: 0 in 0.973s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:37 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2 Jul 21 08:17:37 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:38 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60974d8a-4710-4189-acbb-aef8fc790bb2" returned: 0 in 0.766s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-quobyte-60974d8a-4710-4189-acbb-aef8fc790bb2" released by "delete_volume" :: held 1.862s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Created reservations ['55322638-7814-4ca7-ad7c-f931715e4253', 'b1205f30-2641-4fdb-ae21-22c850b55a34', 'a7af1430-a7e5-4ff6-8556-2f0857953a25', '40eae83f-e1b0-465a-952e-a26251232b8d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:39 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:39 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:39 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.967s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:39 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Deleted volume successfully. Jul 21 08:17:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9c6e5be3-7a09-4375-9476-0bd15c016670 tempest-VolumeSnapshotQuotasNegativeTestJSON-85271713 None] Lock "cinder-60974d8a-4710-4189-acbb-aef8fc790bb2-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:43 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9" returned: 0 in 7.638s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0cd0a-94e4-4fe5-aca7-47f06e687f8a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:43 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:17:43 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:44 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.891s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:17:44 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Converted 1024.00 MB image at 134.05 MB/s Jul 21 08:17:44 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 is being set with open permissions: ugo+rw Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:44 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 Jul 21 08:17:44 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:44 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" released by "_copy_volume_from_snapshot" :: held 10.210s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c-cb7e1603-b2ea-4717-832d-6e7c00f18af9" released by "_create_volume_from_snapshot" :: held 10.262s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.288s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874b899b-bfc3-4220-a523-09a3e7d3ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9', 'volume_size': 1, 'snapshot_id': '116510ca-7950-4f63-9a7c-0dd78d2e577c'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e4482a-7d7d-4a35-b984-32d9553c4f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:17:44 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Volume volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 (cb7e1603-b2ea-4717-832d-6e7c00f18af9): created successfully Jul 21 08:17:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e4482a-7d7d-4a35-b984-32d9553c4f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:17:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Flow 'volume_create_manager' (af5c0fde-aa61-4f63-b50b-cd7d8497312d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:17:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c57d6341-378e-4d46-a603-c38b1cfaea7c tempest-TestStampPattern-1131871713 None] Created volume successfully. Jul 21 08:17:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-e816c91a-116b-49ee-9bd4-f24904ffdeb6-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-e816c91a-116b-49ee-9bd4-f24904ffdeb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-quobyte-e816c91a-116b-49ee-9bd4-f24904ffdeb6" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-e816c91a-116b-49ee-9bd4-f24904ffdeb6" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1cd64b-acb9-44c9-8dbe-e1682dad271f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:48 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 Jul 21 08:17:48 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:48 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6" returned: 0 in 0.523s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:48 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6 Jul 21 08:17:48 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:48 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e816c91a-116b-49ee-9bd4-f24904ffdeb6" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-e816c91a-116b-49ee-9bd4-f24904ffdeb6" released by "delete_volume" :: held 0.961s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Created reservations ['e5e23057-fb6f-4d1a-9941-1b11735a866e', '919217d2-1db1-4190-b7cc-57f87264215f', 'b7c90d15-753b-4d46-88bc-ddd1534a5a18', '88db5e8f-5e51-43ee-8a3a-09b7f31d3a77'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:49 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:49 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:49 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Deleted volume successfully. Jul 21 08:17:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6e95dad0-b20e-46a6-87a6-f6e7db15eeb0 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-e816c91a-116b-49ee-9bd4-f24904ffdeb6-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-2438be11-3fcb-477a-be4a-3c093daa84b1-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-2438be11-3fcb-477a-be4a-3c093daa84b1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-quobyte-2438be11-3fcb-477a-be4a-3c093daa84b1" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-2438be11-3fcb-477a-be4a-3c093daa84b1" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca584f04-2d1a-4c9a-a332-b0b7f75090fe]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:50 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 Jul 21 08:17:50 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:51 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1" returned: 0 in 0.665s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:51 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1 Jul 21 08:17:51 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:51 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2438be11-3fcb-477a-be4a-3c093daa84b1" returned: 0 in 0.413s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-2438be11-3fcb-477a-be4a-3c093daa84b1" released by "delete_volume" :: held 1.206s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Created reservations ['8bded12c-ea04-4400-b394-37c075d72b44', '85082890-04bf-4031-9802-36d04a935424', '4aca3274-f066-44ef-87b8-843762b7f868', 'a6f20df4-4b03-4d91-9a54-279a5f97a0b6'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:52 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:52 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:52 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.433s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Deleted volume successfully. Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0077a7f4-136c-4e57-bf90-32237f9558e6 tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-2438be11-3fcb-477a-be4a-3c093daa84b1-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:52 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:52 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:53 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-da6b32c3-0cf2-4090-a20b-aea570ba3c9a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-da6b32c3-0cf2-4090-a20b-aea570ba3c9a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "cinder-quobyte-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[23029986-8e17-4d7b-a3c2-10be26c0c6fe]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:53 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a Jul 21 08:17:53 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:53 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" returned: 0 in 0.443s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:53 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a Jul 21 08:17:53 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:54 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-quobyte-da6b32c3-0cf2-4090-a20b-aea570ba3c9a" released by "delete_volume" :: held 0.935s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Created reservations ['e915272b-c248-4e7b-b732-f576213d8c98', 'f3cb4645-df36-4cdf-a81f-cbefe8847450', '2accd204-48e9-44d9-8a4b-b2ec5d3bc0e3', '90a44329-6ea9-4777-a488-f40aa55066c9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:17:54 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:17:54 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:17:54 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.398s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:17:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Deleted volume successfully. Jul 21 08:17:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-54d1ee22-e6a8-4c89-84de-f983ebd7522f tempest-AttachVolumeTestJSON-595923900 None] Lock "cinder-da6b32c3-0cf2-4090-a20b-aea570ba3c9a-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:04 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=84,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=19 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:18:04 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=88,cinder:INSERT=19,cinder:SELECT=70,cinder:DELETE=6 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Flow 'volume_create_manager' (166c652d-37ae-4533-9e0f-e88bbeefe83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba9dd5-7523-4bdd-9267-348f1b5306e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba9dd5-7523-4bdd-9267-348f1b5306e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1550163019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e4e00-0c30-46de-921e-e2a804aac00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb746fe63b941c499d726a59441a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:07Z,use_quota=True,user_id='cde70da92aea4145a55fae0e0a582978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121d4d0e-922a-4988-862a-67832712ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121d4d0e-922a-4988-862a-67832712ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304032c5-fb07-4d3f-af5a-503058714654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304032c5-fb07-4d3f-af5a-503058714654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518e4e00-0c30-46de-921e-e2a804aac00f', 'volume_name': 'volume-518e4e00-0c30-46de-921e-e2a804aac00f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7390a0-d1d9-479a-a518-7bf85e2e0a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7390a0-d1d9-479a-a518-7bf85e2e0a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c705d-24b7-482b-935e-c7dd01792452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Volume 518e4e00-0c30-46de-921e-e2a804aac00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518e4e00-0c30-46de-921e-e2a804aac00f', 'volume_size': 1} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1550163019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e4e00-0c30-46de-921e-e2a804aac00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb746fe63b941c499d726a59441a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:07Z,use_quota=True,user_id='cde70da92aea4145a55fae0e0a582978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Creating volume 518e4e00-0c30-46de-921e-e2a804aac00f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:06 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:06 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f 1073741824 Jul 21 08:18:06 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:07 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f 1073741824" returned: 0 in 0.539s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:07 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f Jul 21 08:18:07 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:07 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f" returned: 0 in 0.318s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400c705d-24b7-482b-935e-c7dd01792452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518e4e00-0c30-46de-921e-e2a804aac00f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79a1b23-b6d4-406a-bfb6-b1fc1f3f12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Volume volume-518e4e00-0c30-46de-921e-e2a804aac00f (518e4e00-0c30-46de-921e-e2a804aac00f): created successfully Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79a1b23-b6d4-406a-bfb6-b1fc1f3f12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Flow 'volume_create_manager' (166c652d-37ae-4533-9e0f-e88bbeefe83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6bce7481-1bd1-44c5-8e8d-ab6633d297f7 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-816457011: creating Jul 21 08:18:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b2075dc8-3a93-4a40-afc7-985b7a7ad865 tempest-VolumesTransfersV355Test-243475616 None] Created volume successfully. Jul 21 08:18:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6bce7481-1bd1-44c5-8e8d-ab6633d297f7 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-816457011: created successfully Jul 21 08:18:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6bce7481-1bd1-44c5-8e8d-ab6633d297f7 tempest-GroupSnapshotsTest-2114430932 None] Create group completed successfully. Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (e684d66b-48a7-4d02-8659-c43959e3b692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c6a92-cd53-4ed8-91fd-6c0688b8c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a3296c51-8579-4fbf-a749-481f1a922a5f tempest-VolumesTransfersV355Test-951002138 None] Transfer volume completed successfully. Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c6a92-cd53-4ed8-91fd-6c0688b8c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-689070277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ca22779-bc88-4bbe-b769-d159534cff68,host='devstack@QuobyteHD#QuobyteHD',id=e098c329-b163-4e5c-b813-cc2a8c17b9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:10Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(169600bc-2d33-4161-b3be-83fcb5e23214),volume_type_id=169600bc-2d33-4161-b3be-83fcb5e23214)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4afde2-6046-4022-9a30-b12ea6826e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4afde2-6046-4022-9a30-b12ea6826e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64eae06-63d7-4b1f-8cb5-2c4bb49ef955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64eae06-63d7-4b1f-8cb5-2c4bb49ef955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e098c329-b163-4e5c-b813-cc2a8c17b9ed', 'volume_name': 'volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1ae816-2cb3-4416-bd4f-a008a9b68725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1ae816-2cb3-4416-bd4f-a008a9b68725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3126d-0948-4c70-8f00-28386b8ff834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Volume e098c329-b163-4e5c-b813-cc2a8c17b9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed', 'volume_size': 1} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ca22779-bc88-4bbe-b769-d159534cff68,created_at=2026-07-21T06:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-689070277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ca22779-bc88-4bbe-b769-d159534cff68,host='devstack@QuobyteHD#QuobyteHD',id=e098c329-b163-4e5c-b813-cc2a8c17b9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:10Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(169600bc-2d33-4161-b3be-83fcb5e23214),volume_type_id=169600bc-2d33-4161-b3be-83fcb5e23214)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Creating volume e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:09 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:09 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed 1073741824 Jul 21 08:18:09 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:10 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed 1073741824" returned: 0 in 0.652s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "cinder-518e4e00-0c30-46de-921e-e2a804aac00f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-518e4e00-0c30-46de-921e-e2a804aac00f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:10 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:10 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "cinder-quobyte-518e4e00-0c30-46de-921e-e2a804aac00f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-quobyte-518e4e00-0c30-46de-921e-e2a804aac00f" acquired by "delete_volume" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ce22f-5d55-4ff9-a07d-49b9b74ec3a1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:10 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f Jul 21 08:18:10 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:10 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.281s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3126d-0948-4c70-8f00-28386b8ff834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac12b6b-2ec5-4bf9-b72f-613a1561c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Volume volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed (e098c329-b163-4e5c-b813-cc2a8c17b9ed): created successfully Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac12b6b-2ec5-4bf9-b72f-613a1561c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (e684d66b-48a7-4d02-8659-c43959e3b692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1cccf255-c496-4451-8d61-cef2e3736abc tempest-GroupSnapshotsTest-2114430932 None] Created volume successfully. Jul 21 08:18:11 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f" returned: 0 in 0.498s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:11 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f Jul 21 08:18:11 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:11 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-518e4e00-0c30-46de-921e-e2a804aac00f" returned: 0 in 0.472s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-quobyte-518e4e00-0c30-46de-921e-e2a804aac00f" released by "delete_volume" :: held 1.027s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Created reservations ['e6a3626f-cb9b-45c7-b889-7480ba881760', 'e4330776-1fb0-47b8-a286-36cc91ed2f33', '284dbb85-6b5c-4268-9c40-d0edeb2708c8', 'bb290f60-5714-4de6-b361-5dcc44e51228'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:11 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:11 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:12 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Deleted volume successfully. Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ecfd3888-0ea1-46ef-82a1-3fc857e34571 tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-518e4e00-0c30-46de-921e-e2a804aac00f-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] GroupSnapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: creating. Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Group snapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: creating. {{(pid=87372) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Creating offline snapshot f87800e0-06b5-467d-83fb-7da28a4917c3 of volume e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf41c7-0071-4894-a1b1-dbf50cc5df09]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:12 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:12 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:13 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.519s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:13 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 1G Jul 21 08:18:13 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:13 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 1G" returned: 0 in 0.591s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:13 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:13 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Flow 'volume_create_manager' (ffcd0ba7-0c7e-44bd-b6c9-1ee2f125fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22e64a3-6bd9-46e7-8c86-8b44788fde36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:14 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22e64a3-6bd9-46e7-8c86-8b44788fde36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-159921882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5032c9-cb85-488b-9473-599293571096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb746fe63b941c499d726a59441a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:14Z,use_quota=True,user_id='cde70da92aea4145a55fae0e0a582978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8467e821-6f95-403f-92a0-5004031add2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8467e821-6f95-403f-92a0-5004031add2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4854abe1-dd0a-4785-ade4-cd7c824e611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4854abe1-dd0a-4785-ade4-cd7c824e611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5032c9-cb85-488b-9473-599293571096', 'volume_name': 'volume-4c5032c9-cb85-488b-9473-599293571096', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3d43b-c83d-4245-b100-d12307b05d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b3d43b-c83d-4245-b100-d12307b05d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d96b84-a1d7-4ae4-9b85-848d9fc7c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Volume 4c5032c9-cb85-488b-9473-599293571096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5032c9-cb85-488b-9473-599293571096', 'volume_size': 1} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.387s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:14 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:14 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:14 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:14 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.251s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:14 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info Jul 21 08:18:14 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:14 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:14 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:14 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info Jul 21 08:18:14 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:15 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.info" returned: 0 in 0.407s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-159921882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5032c9-cb85-488b-9473-599293571096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb746fe63b941c499d726a59441a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:14Z,use_quota=True,user_id='cde70da92aea4145a55fae0e0a582978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Creating volume 4c5032c9-cb85-488b-9473-599293571096 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:15 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:15 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 1073741824 Jul 21 08:18:15 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-59079879-ac56-4d48-9f9a-295d30d115c2 tempest-GroupSnapshotsTest-2114430932 None] group_snapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: created successfully Jul 21 08:18:15 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 1073741824" returned: 0 in 0.707s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:15 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 Jul 21 08:18:15 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:16 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096" returned: 0 in 0.325s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d96b84-a1d7-4ae4-9b85-848d9fc7c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5032c9-cb85-488b-9473-599293571096', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5efe3f1-e0d0-4293-a33d-2d4cddf514bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Volume volume-4c5032c9-cb85-488b-9473-599293571096 (4c5032c9-cb85-488b-9473-599293571096): created successfully Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5efe3f1-e0d0-4293-a33d-2d4cddf514bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Flow 'volume_create_manager' (ffcd0ba7-0c7e-44bd-b6c9-1ee2f125fb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-18349326-aaf3-447e-b6a8-cbe4acaf73f5 tempest-VolumesTransfersV355Test-243475616 None] Created volume successfully. Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3-06524594-58fd-4816-bd2e-90992e976675" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3-06524594-58fd-4816-bd2e-90992e976675" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Creating volume 06524594-58fd-4816-bd2e-90992e976675 from snapshot f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] snapshot: f87800e0-06b5-467d-83fb-7da28a4917c3, volume: 06524594-58fd-4816-bd2e-90992e976675, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8064cda-c11a-4f8b-a7ea-d3f0639147e4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:16 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:16 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:17 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.465s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[72639b7f-fa40-4883-9cbe-b6a2a67e5b97]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:17 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:17 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Flow 'volume_create_manager' (60d07ad3-557b-4e33-a883-a009494b36f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd65770e-aced-4bbb-be78-f7ab6370fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd65770e-aced-4bbb-be78-f7ab6370fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1132399369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf954be5-2856-4945-beb4-3f8e8885e77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a426ea0d4431d9586030aee26f8ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:17Z,use_quota=True,user_id='832e840914114dd28b73ebbbca9d0849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc5e11f-7f1f-4f4b-8ddd-57c9932791b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc5e11f-7f1f-4f4b-8ddd-57c9932791b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cff993-cb62-45c7-9d3e-99646aa7aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cff993-cb62-45c7-9d3e-99646aa7aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf954be5-2856-4945-beb4-3f8e8885e77c', 'volume_name': 'volume-bf954be5-2856-4945-beb4-3f8e8885e77c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2839cc2-4475-4a02-bef5-abba0252480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2839cc2-4475-4a02-bef5-abba0252480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18390cbe-7e31-42c8-a894-24fcdc040403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Volume bf954be5-2856-4945-beb4-3f8e8885e77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf954be5-2856-4945-beb4-3f8e8885e77c', 'volume_size': 1} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "cinder-4c5032c9-cb85-488b-9473-599293571096-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-4c5032c9-cb85-488b-9473-599293571096-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "cinder-quobyte-4c5032c9-cb85-488b-9473-599293571096" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-quobyte-4c5032c9-cb85-488b-9473-599293571096" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3024c3f-8018-4075-90aa-0d86b82d7847]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:17 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.557s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:18:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:17 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 Jul 21 08:18:17 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:17 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 Jul 21 08:18:17 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:18 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:18 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096 Jul 21 08:18:18 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:18 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c5032c9-cb85-488b-9473-599293571096" returned: 0 in 0.540s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-quobyte-4c5032c9-cb85-488b-9473-599293571096" released by "delete_volume" :: held 0.990s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Created reservations ['c5be7cd4-2948-45b8-b762-5b3f1c9c3060', '0e9a543c-f20b-4f57-b62a-ab1f48b94563', '67a21e1e-c65b-4367-93bf-fcf94e812086', 'f4a56967-e4c9-44dd-98d4-558cd4905430'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:19 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:19 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:19 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.730s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Deleted volume successfully. Jul 21 08:18:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-74a157e9-c39c-4345-aa0f-493853d3629f tempest-VolumesTransfersV355Test-709816760 None] Lock "cinder-4c5032c9-cb85-488b-9473-599293571096-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675" returned: 0 in 6.554s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2253f53-b83a-41ab-9871-5456dc9dc426]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:24 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:24 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:24 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.644s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:18:24 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Converted 1024.00 MB image at 156.21 MB/s Jul 21 08:18:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:24 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 Jul 21 08:18:24 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:25 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" released by "_copy_volume_from_snapshot" :: held 8.659s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3-06524594-58fd-4816-bd2e-90992e976675" released by "_create_volume_from_snapshot" :: held 8.707s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.739s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.726s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1132399369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf954be5-2856-4945-beb4-3f8e8885e77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03a426ea0d4431d9586030aee26f8ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:17Z,use_quota=True,user_id='832e840914114dd28b73ebbbca9d0849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Creating volume bf954be5-2856-4945-beb4-3f8e8885e77c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:25 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:25 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c 1073741824 Jul 21 08:18:25 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-9d4bff02-cf25-4237-a14a-02a41e787d9e tempest-GroupSnapshotsTest-2114430932 None] Create group from source-snapshot-d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9 completed successfully. Jul 21 08:18:25 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c 1073741824" returned: 0 in 0.610s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:25 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c Jul 21 08:18:25 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:26 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.777s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18390cbe-7e31-42c8-a894-24fcdc040403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf954be5-2856-4945-beb4-3f8e8885e77c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c352d85-2194-47ed-bf48-37e8d0a91fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7401dd-6401-4c2e-a200-8e7c7193e263]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Volume volume-bf954be5-2856-4945-beb4-3f8e8885e77c (bf954be5-2856-4945-beb4-3f8e8885e77c): created successfully Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c352d85-2194-47ed-bf48-37e8d0a91fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Flow 'volume_create_manager' (60d07ad3-557b-4e33-a883-a009494b36f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f0b7e81c-ea63-4b45-8539-f1738a8162ac tempest-TestMinimumBasicScenario-1808839248 None] Created volume successfully. Jul 21 08:18:26 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 Jul 21 08:18:26 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:26 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9" returned: 0 in 0.437s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.512s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '075f34f0-ef92-4b78-8008-5a62f6e84e82', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:18:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-2b134b4a-6efd-429b-b135-de02d74e12b7 req-47124c48-090c-4c0c-afc5-d19d30078227 tempest-TestStampPattern-1131871713 None] attachment_update completed successfully. Jul 21 08:18:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" acquired by "delete_volume" :: waited 0.062s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3070d67-c009-460d-b56c-00cdfd9322ae]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:27 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 Jul 21 08:18:27 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:28 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675" returned: 0 in 0.439s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:28 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675 Jul 21 08:18:28 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-61fef0e7-de01-43f3-8a16-7aafc111b4ab req-f12737f3-8e18-4398-b1c3-bc5aea35fd87 tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-61fef0e7-de01-43f3-8a16-7aafc111b4ab req-f12737f3-8e18-4398-b1c3-bc5aea35fd87 tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-61fef0e7-de01-43f3-8a16-7aafc111b4ab req-f12737f3-8e18-4398-b1c3-bc5aea35fd87 tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-61fef0e7-de01-43f3-8a16-7aafc111b4ab req-f12737f3-8e18-4398-b1c3-bc5aea35fd87 tempest-TestMinimumBasicScenario-1808839248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-bf954be5-2856-4945-beb4-3f8e8885e77c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a52df0a5-4337-4bf9-8698-bcce72da4fa3', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:18:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-61fef0e7-de01-43f3-8a16-7aafc111b4ab req-f12737f3-8e18-4398-b1c3-bc5aea35fd87 tempest-TestMinimumBasicScenario-1808839248 None] attachment_update completed successfully. Jul 21 08:18:28 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06524594-58fd-4816-bd2e-90992e976675" returned: 0 in 0.338s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-06524594-58fd-4816-bd2e-90992e976675" released by "delete_volume" :: held 0.883s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['e0a033ef-2fa4-4f4c-967a-e74c1a4d67ca'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:28 devstack cinder-volume[87372]: WARNING cinder.quota [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1287706270 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1287706270, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:18:28 devstack cinder-volume[87372]: WARNING cinder.quota [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1287706270 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1287706270, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['8871a4ee-4736-4f1c-aa41-bd974dcda4b3', '2ed8b57f-5800-4ced-855a-d76adaf6309a', 'cb48b8dc-1ddb-4a48-8d4b-702055c88aed', '3060d013-9932-4ce1-84d9-3b29d4041461'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:28 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:28 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] group_snapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: deleting Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] group_snapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: deleting {{(pid=87372) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 08:18:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Deleting offline snapshot f87800e0-06b5-467d-83fb-7da28a4917c3 of volume e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:18:29 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] snapshot_file for this snap is: volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b03c7e-cf68-4f64-8f86-8be85ecf3807]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-355d9c7d-e772-43b3-912f-805a75f2ae9c tempest-GroupSnapshotsTest-2114430932 None] Delete group completed successfully. Jul 21 08:18:29 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:29 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:29 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.485s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d44c07-c208-49b6-a8cd-f6de9791a30c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:29 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:29 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:30 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.435s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:30 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:30 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a497687f-fdb1-4b40-9493-f65523ae1480 req-bf654b6e-a877-4369-93bc-97eda4fa7f6a tempest-TestStampPattern-1131871713 None] Terminate volume connection completed successfully. Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-a497687f-fdb1-4b40-9493-f65523ae1480 req-bf654b6e-a877-4369-93bc-97eda4fa7f6a tempest-TestStampPattern-1131871713 None] Deleting attachment 075f34f0-ef92-4b78-8008-5a62f6e84e82. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:18:30 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.502s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:30 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3 Jul 21 08:18:30 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:30 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed.f87800e0-06b5-467d-83fb-7da28a4917c3" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-f87800e0-06b5-467d-83fb-7da28a4917c3" released by "_delete_snapshot" :: held 1.963s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" released by "delete_snapshot" :: held 2.015s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:31 devstack cinder-volume[87372]: WARNING cinder.quota [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1287706270 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1287706270, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['99bcf9f4-345b-416d-9731-63cb999dc405', '68ccff91-ce13-4119-bdd2-8fa416e24d1e', '64577336-fd98-4dc2-9709-a8380fb6d50b', '11692746-da50-49b5-ba53-7841996f8e47'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-25dad0c6-4aa5-4e5a-a65a-90e6e95ebdae tempest-GroupSnapshotsTest-2114430932 None] group_snapshot d78e6ce2-d66c-4f6f-92db-fbd5a0381ae9: deleted successfully Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00ffa5-17c5-4a22-9966-9da2bf2564d0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:31 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:31 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:32 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Flow 'volume_create_manager' (519f5520-761e-4cde-9969-09e84448f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca2e329-eeaf-4d48-aded-e4b9c1bc507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.815s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca2e329-eeaf-4d48-aded-e4b9c1bc507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680867761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e94ae0-c7fa-4a4f-818d-c903dd1d4422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e8ecc2b5b84120819d0dc907d017bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:32Z,use_quota=True,user_id='298c1edff61642a8bb068e27253878bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaf1cc9-6838-41ce-86da-15de25d7e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaf1cc9-6838-41ce-86da-15de25d7e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:32 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed Jul 21 08:18:32 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0abf8b6-61b7-45e7-b4e9-a18e0dacd653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0abf8b6-61b7-45e7-b4e9-a18e0dacd653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e94ae0-c7fa-4a4f-818d-c903dd1d4422', 'volume_name': 'volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a7bd9a-6a87-4156-b7bf-e95611773ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a7bd9a-6a87-4156-b7bf-e95611773ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a89bb-a6e2-48c6-844f-5b5de5e1af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:32 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Volume 69e94ae0-c7fa-4a4f-818d-c903dd1d4422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422', 'volume_size': 1} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1680867761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e94ae0-c7fa-4a4f-818d-c903dd1d4422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e8ecc2b5b84120819d0dc907d017bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:32Z,use_quota=True,user_id='298c1edff61642a8bb068e27253878bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Creating volume 69e94ae0-c7fa-4a4f-818d-c903dd1d4422 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:32 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:32 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 1073741824 Jul 21 08:18:32 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:33 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e098c329-b163-4e5c-b813-cc2a8c17b9ed" returned: 0 in 0.788s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e098c329-b163-4e5c-b813-cc2a8c17b9ed" released by "delete_volume" :: held 1.724s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['a36cb8b0-0048-4ae8-9207-bdcb44bcf8c0'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:33 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 1073741824" returned: 0 in 0.919s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:33 devstack cinder-volume[87372]: WARNING cinder.db.api [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1287706270'] Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['a78fd9ef-19f6-4d69-ad13-16e039521909', 'aaaa3f89-6248-4280-b714-c3b9219bd787', 'e3430427-dc50-400b-b2c0-3c2bf01b4ae8', '68d7a314-9282-40b1-8aff-f52783213e36'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:33 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 Jul 21 08:18:33 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:34 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:34 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:34 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" returned: 0 in 0.480s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa4a89bb-a6e2-48c6-844f-5b5de5e1af83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4d5ce2-0288-4919-94ad-67de839ab282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Volume volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 (69e94ae0-c7fa-4a4f-818d-c903dd1d4422): created successfully Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4d5ce2-0288-4919-94ad-67de839ab282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Flow 'volume_create_manager' (519f5520-761e-4cde-9969-09e84448f02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-19b053bf-7f45-4fb9-9256-73fbeef1962e tempest-VolumesTransfersV357Test-338573321 None] Created volume successfully. Jul 21 08:18:34 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.451s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:34 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2d1f63ba-bb62-403c-8076-5271ca727951 tempest-GroupSnapshotsTest-2114430932 None] Delete group completed successfully. Jul 21 08:18:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5f6ad723-adb5-41e4-b740-54c310853892 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-720903977: creating Jul 21 08:18:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5f6ad723-adb5-41e4-b740-54c310853892 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-720903977: created successfully Jul 21 08:18:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5f6ad723-adb5-41e4-b740-54c310853892 tempest-GroupSnapshotsTest-2114430932 None] Create group completed successfully. Jul 21 08:18:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-60be22db-082d-4506-b0e6-d8c70ef3e5c3 tempest-VolumesTransfersV357Test-1337687469 None] Transfer volume completed successfully. Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "cinder-69e94ae0-c7fa-4a4f-818d-c903dd1d4422-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-69e94ae0-c7fa-4a4f-818d-c903dd1d4422-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-cb7e1603-b2ea-4717-832d-6e7c00f18af9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "cinder-quobyte-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "cinder-cb7e1603-b2ea-4717-832d-6e7c00f18af9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-quobyte-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b7e35-c7ff-4b04-8ec6-aa7e9f2ae347]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e38819-85a5-460b-b35a-b67649253f9b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:36 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 Jul 21 08:18:36 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:36 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 Jul 21 08:18:36 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:37 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" returned: 0 in 0.449s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:37 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422 Jul 21 08:18:37 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (ebdf3af2-8569-40d7-b72d-e56a88651bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534fa730-855b-4ca4-912b-e899647b1bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534fa730-855b-4ca4-912b-e899647b1bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244919183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3017951-4574-4d0e-b966-17e26a7f0a45,host='devstack@QuobyteHD#QuobyteHD',id=285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:37Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c99183f-da13-45e7-91f0-8837f3ff2767),volume_type_id=2c99183f-da13-45e7-91f0-8837f3ff2767)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd8eeec-676b-41cd-a31f-a482e55654fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd8eeec-676b-41cd-a31f-a482e55654fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:37 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10577fc2-ad58-4214-baa7-b78bcf9babb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10577fc2-ad58-4214-baa7-b78bcf9babb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea', 'volume_name': 'volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef976a-1b41-440a-94da-ca850b15e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef976a-1b41-440a-94da-ca850b15e48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f0f9a1-b532-4212-a991-4e4820a261b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Volume 285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea', 'volume_size': 1} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3017951-4574-4d0e-b966-17e26a7f0a45,created_at=2026-07-21T06:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244919183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3017951-4574-4d0e-b966-17e26a7f0a45,host='devstack@QuobyteHD#QuobyteHD',id=285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:37Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c99183f-da13-45e7-91f0-8837f3ff2767),volume_type_id=2c99183f-da13-45e7-91f0-8837f3ff2767)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Creating volume 285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9" returned: 0 in 0.647s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:37 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea 1073741824 Jul 21 08:18:37 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:37 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9 Jul 21 08:18:37 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:37 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" returned: 0 in 0.364s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-quobyte-69e94ae0-c7fa-4a4f-818d-c903dd1d4422" released by "delete_volume" :: held 0.890s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Created reservations ['a0e9aca0-557e-4ffb-8cde-3b3c9c80f83e', 'dca8163e-f662-482d-90e0-57be256f401a', '40f068a7-29ae-43f7-b785-7feae9935108', 'd275d926-0cf6-421e-ad8d-bdcb73e99ca3'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:37 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:37 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:37 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-cb7e1603-b2ea-4717-832d-6e7c00f18af9" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-cb7e1603-b2ea-4717-832d-6e7c00f18af9" released by "delete_volume" :: held 1.135s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Created reservations ['9528414d-f3f3-40a3-bae8-dfbd46f4c5bc', 'b9c188eb-8b27-47d6-b08f-b5e10cdb3ad6', 'b8a8eec8-2556-4638-84dc-e458ba79e6d1', 'e40a99f5-2b8a-4cee-87ef-49c0bdf70846'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:38 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:38 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.367s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Deleted volume successfully. Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea 1073741824" returned: 0 in 0.649s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5abf9a2c-8ed4-4b4d-b37c-d0bd890ba469 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-69e94ae0-c7fa-4a4f-818d-c903dd1d4422-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:38 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:38 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:38 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea Jul 21 08:18:38 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Flow 'volume_create_manager' (c1c65504-2e87-4cd7-a286-a27962852053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e5bb10-5e9a-4e84-86e5-581754e514ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e5bb10-5e9a-4e84-86e5-581754e514ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-119759788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3ce98-a7c9-4e0b-a301-455e268506d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e8ecc2b5b84120819d0dc907d017bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:38Z,use_quota=True,user_id='298c1edff61642a8bb068e27253878bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a475f-b889-4fa5-acc5-87c1aaf918cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a475f-b889-4fa5-acc5-87c1aaf918cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d7e00f-69bf-466e-998e-50e4661b3243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d7e00f-69bf-466e-998e-50e4661b3243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e3ce98-a7c9-4e0b-a301-455e268506d1', 'volume_name': 'volume-03e3ce98-a7c9-4e0b-a301-455e268506d1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f9fc2-d6dc-43a7-b5da-d0acb2d21740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f9fc2-d6dc-43a7-b5da-d0acb2d21740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c01490-16dc-4d58-9781-c6a3ff3ee9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Volume 03e3ce98-a7c9-4e0b-a301-455e268506d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e3ce98-a7c9-4e0b-a301-455e268506d1', 'volume_size': 1} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" returned: 0 in 0.341s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-119759788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e3ce98-a7c9-4e0b-a301-455e268506d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e8ecc2b5b84120819d0dc907d017bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:38Z,use_quota=True,user_id='298c1edff61642a8bb068e27253878bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Creating volume 03e3ce98-a7c9-4e0b-a301-455e268506d1 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:38 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.424s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Deleted volume successfully. Jul 21 08:18:38 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 1073741824 Jul 21 08:18:38 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f0f9a1-b532-4212-a991-4e4820a261b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b57dea0-538f-4497-b7a2-9f21603cb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3850428e-4f40-4c00-af4d-ba2e15b9155c tempest-TestStampPattern-1131871713 None] Lock "cinder-cb7e1603-b2ea-4717-832d-6e7c00f18af9-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Volume volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea (285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea): created successfully Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b57dea0-538f-4497-b7a2-9f21603cb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (ebdf3af2-8569-40d7-b72d-e56a88651bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e1ebe31c-1bc7-445c-a261-cf840115cf09 tempest-GroupSnapshotsTest-2114430932 None] Created volume successfully. Jul 21 08:18:39 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 1073741824" returned: 0 in 0.554s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:39 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 Jul 21 08:18:39 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-116510ca-7950-4f63-9a7c-0dd78d2e577c-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-116510ca-7950-4f63-9a7c-0dd78d2e577c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Deleting offline snapshot 116510ca-7950-4f63-9a7c-0dd78d2e577c of volume bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] snapshot_file for this snap is: volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d880dc61-1191-402a-815f-2f1a98cd9cd6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:39 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1" returned: 0 in 0.368s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c01490-16dc-4d58-9781-c6a3ff3ee9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e3ce98-a7c9-4e0b-a301-455e268506d1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93f33a3-4a87-4b99-b213-40eb6fd3a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Volume volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 (03e3ce98-a7c9-4e0b-a301-455e268506d1): created successfully Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93f33a3-4a87-4b99-b213-40eb6fd3a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Flow 'volume_create_manager' (c1c65504-2e87-4cd7-a286-a27962852053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f5f403c4-fa48-4e15-8611-962c18cef57d tempest-VolumesTransfersV357Test-338573321 None] Created volume successfully. Jul 21 08:18:39 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:18:39 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:40 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.502s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcabc91b-1932-4f7d-86cf-0b0df415510c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4fa5eb-2b8a-4b01-8e68-c2b0b0707482]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:40 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:18:40 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (ecbfe6c2-1c8c-4919-ad9a-2eac97a6a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4454ff5-c838-4a70-a0c8-fabf325c24dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4454ff5-c838-4a70-a0c8-fabf325c24dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647197637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3017951-4574-4d0e-b966-17e26a7f0a45,host='devstack@QuobyteHD#QuobyteHD',id=e3d4f9e0-9d45-446d-ac9f-cfe663abcaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:40Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c99183f-da13-45e7-91f0-8837f3ff2767),volume_type_id=2c99183f-da13-45e7-91f0-8837f3ff2767)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6122efad-bd9e-4e8a-a147-50c22d2506e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6122efad-bd9e-4e8a-a147-50c22d2506e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22a816d-e6ae-43e4-8372-f5a65c8a5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22a816d-e6ae-43e4-8372-f5a65c8a5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d4f9e0-9d45-446d-ac9f-cfe663abcaae', 'volume_name': 'volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b70054-30c9-42b9-9a22-df9516937651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b70054-30c9-42b9-9a22-df9516937651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55c052-7503-44b5-b366-eff326ac11e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:40 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Volume e3d4f9e0-9d45-446d-ac9f-cfe663abcaae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae', 'volume_size': 1} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3017951-4574-4d0e-b966-17e26a7f0a45,created_at=2026-07-21T06:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1647197637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3017951-4574-4d0e-b966-17e26a7f0a45,host='devstack@QuobyteHD#QuobyteHD',id=e3d4f9e0-9d45-446d-ac9f-cfe663abcaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:40Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c99183f-da13-45e7-91f0-8837f3ff2767),volume_type_id=2c99183f-da13-45e7-91f0-8837f3ff2767)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Creating volume e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:40 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.532s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:40 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae 1073741824 Jul 21 08:18:40 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:40 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:18:40 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:41 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.419s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "cinder-03e3ce98-a7c9-4e0b-a301-455e268506d1-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:41 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c Jul 21 08:18:41 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-03e3ce98-a7c9-4e0b-a301-455e268506d1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:41 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae 1073741824" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "cinder-quobyte-03e3ce98-a7c9-4e0b-a301-455e268506d1" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-quobyte-03e3ce98-a7c9-4e0b-a301-455e268506d1" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901cdfc-52f3-409c-a2a6-a0910e4a9a24]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:41 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae Jul 21 08:18:41 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:41 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 Jul 21 08:18:41 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:41 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c.116510ca-7950-4f63-9a7c-0dd78d2e577c" returned: 0 in 0.335s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-116510ca-7950-4f63-9a7c-0dd78d2e577c" released by "_delete_snapshot" :: held 1.936s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" released by "delete_snapshot" :: held 1.975s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:41 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Created reservations ['dee53d8a-b1fd-42d5-8fd6-0e5fb2a249cf', '64e9fecc-137e-4a22-a67b-c1eda7efaf26', 'f7b0c2a0-20eb-41f4-b6c4-e7578b1a8b46', 'a903c65e-8190-40f1-b5ee-32226d11a0a9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55c052-7503-44b5-b366-eff326ac11e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddded31-84a4-4c22-857f-6a67e8b7880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Volume volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae (e3d4f9e0-9d45-446d-ac9f-cfe663abcaae): created successfully Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddded31-84a4-4c22-857f-6a67e8b7880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (ecbfe6c2-1c8c-4919-ad9a-2eac97a6a97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-59fdbc90-447e-4a1c-8e04-e0b834bae4a6 tempest-GroupSnapshotsTest-2114430932 None] Created volume successfully. Jul 21 08:18:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Delete snapshot completed successfully. Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-57f368e6-fc6c-47bc-a0c7-146fec2c618c tempest-TestStampPattern-1131871713 None] Lock "cinder-116510ca-7950-4f63-9a7c-0dd78d2e577c-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:41 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:41 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1 Jul 21 08:18:41 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-aba3714e-f22f-4d06-8ba6-83cfbf787ee8 tempest-GroupSnapshotsTest-2114430932 None] Update group completed successfully. Jul 21 08:18:41 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-03e3ce98-a7c9-4e0b-a301-455e268506d1" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-quobyte-03e3ce98-a7c9-4e0b-a301-455e268506d1" released by "delete_volume" :: held 0.756s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:41 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Created reservations ['58d93501-fc10-4f69-95d4-27d67b680581', 'd12d6eb4-b2d5-4d07-b496-4219c48f6204', 'f81cafaa-fccf-429a-8be6-c3fdd6b3cb3f', '40915523-f751-41e0-96d1-7451b8e54baa'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:42 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:42 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:42 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.257s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Deleted volume successfully. Jul 21 08:18:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-11beda35-3f5b-4a43-a6f3-e950fd67e8c4 tempest-VolumesTransfersV357Test-139698242 None] Lock "cinder-03e3ce98-a7c9-4e0b-a301-455e268506d1-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cf038009-a79f-46dd-8692-1d6749e121fb tempest-GroupSnapshotsTest-2114430932 None] Update group completed successfully. Jul 21 08:18:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3d4c5531-38de-4706-895b-728452180397 tempest-GroupSnapshotsTest-2114430932 None] Update group completed successfully. Jul 21 08:18:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f1b5ed73-045e-4fba-bca8-2f5157c264bc tempest-GroupSnapshotsTest-2114430932 None] Update group completed successfully. Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-bcabc91b-1932-4f7d-86cf-0b0df415510c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "cinder-bcabc91b-1932-4f7d-86cf-0b0df415510c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Acquiring lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" acquired by "delete_volume" :: waited 0.050s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9840f1-87dc-462d-bb62-b61eef020ae6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:46 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:18:46 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:47 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:47 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c Jul 21 08:18:47 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] GroupSnapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: creating. Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Group snapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: creating. {{(pid=87372) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Creating offline snapshot 5d3b332f-f5f2-4972-b04d-13a4a2ded061 of volume 285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86337b3-06e1-4722-a6f5-a7aa640ae5ea]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:47 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bcabc91b-1932-4f7d-86cf-0b0df415510c" returned: 0 in 0.282s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "cinder-quobyte-bcabc91b-1932-4f7d-86cf-0b0df415510c" released by "delete_volume" :: held 0.809s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:47 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea Jul 21 08:18:47 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Created reservations ['13181f23-33a7-4a58-9a72-09cbe08a1bd4', '3645c668-bbfe-4296-bb77-1d5ad958e073', 'fdcf7d72-5144-47f7-9059-3df8ca873e62', 'a0749d3e-744c-43eb-ae4b-9a8dbe1a66f7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:47 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:47 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:48 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" returned: 0 in 0.716s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:48 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Deleted volume successfully. Jul 21 08:18:48 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 1G Jul 21 08:18:48 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dba338d-b5b1-43bb-bcfc-131d255a43f0 tempest-TestStampPattern-1131871713 None] Lock "cinder-bcabc91b-1932-4f7d-86cf-0b0df415510c-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:48 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 1G" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:48 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 Jul 21 08:18:48 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:49 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061" returned: 0 in 0.358s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:49 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:49 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 Jul 21 08:18:49 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Flow 'volume_create_manager' (86aa70b6-bae3-4a87-99d2-6172e9154040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5d9111-5694-4b0a-9c75-a320d9edce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5d9111-5694-4b0a-9c75-a320d9edce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-882423658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6aa36c-17e4-4c63-a828-86e3f3c2921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d84518cf1f4aa6978e2ad2f3bab71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:49Z,use_quota=True,user_id='c59977b3615d4ee38237c1659e1bc50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a11afa0-e982-4d94-ad6d-9e4e59e0659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a11afa0-e982-4d94-ad6d-9e4e59e0659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84379757-9319-4010-bf1d-f55ef7043fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84379757-9319-4010-bf1d-f55ef7043fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'volume_name': 'volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d916b93a-769d-4fc7-8d5e-98c517786989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d916b93a-769d-4fc7-8d5e-98c517786989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20918696-4dbd-4bff-a038-d49d7e3a1b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Volume 4c6aa36c-17e4-4c63-a828-86e3f3c2921d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'volume_size': 1} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:49 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:49 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info Jul 21 08:18:49 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:49 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info" returned: 0 in 0.278s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:49 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:49 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info Jul 21 08:18:49 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:49 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.info" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Creating offline snapshot 8236013b-e7a5-45e0-b5b6-309a858eb2ca of volume e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf918028-b812-4920-97cf-64339d8b3a45]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:50 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae Jul 21 08:18:50 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:50 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" returned: 0 in 0.365s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:50 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca 1G Jul 21 08:18:50 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:50 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca 1G" returned: 0 in 0.509s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:50 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca Jul 21 08:18:50 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:51 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca" returned: 0 in 0.392s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:51 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:51 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca Jul 21 08:18:51 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:51 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:51 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info Jul 21 08:18:51 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:51 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:51 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:18:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:51 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info Jul 21 08:18:51 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:52 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.info" returned: 0 in 0.320s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-882423658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6aa36c-17e4-4c63-a828-86e3f3c2921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d84518cf1f4aa6978e2ad2f3bab71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:49Z,use_quota=True,user_id='c59977b3615d4ee38237c1659e1bc50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Creating volume 4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:18:52 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:52 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d 1073741824 Jul 21 08:18:52 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08292ecc-8cd4-4c2c-b17d-9aca6a8b4f29 tempest-GroupSnapshotsTest-2114430932 None] group_snapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: created successfully Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:52 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:18:52 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: deleting Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: deleting {{(pid=87372) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-5d3b332f-f5f2-4972-b04d-13a4a2ded061" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-5d3b332f-f5f2-4972-b04d-13a4a2ded061" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Deleting offline snapshot 5d3b332f-f5f2-4972-b04d-13a4a2ded061 of volume 285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] snapshot_file for this snap is: volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b157a83-deea-4c5b-a797-c4f9ecff7e14]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:53 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.420s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:18:53 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d 1073741824" returned: 0 in 1.010s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:53 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:18:53 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:53 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 Jul 21 08:18:53 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:53 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.510s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20918696-4dbd-4bff-a038-d49d7e3a1b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:53 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf4ef80-a159-42b2-9e98-96a0640948ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061" returned: 0 in 0.795s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:53 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Volume volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d (4c6aa36c-17e4-4c63-a828-86e3f3c2921d): created successfully Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf4ef80-a159-42b2-9e98-96a0640948ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Flow 'volume_create_manager' (86aa70b6-bae3-4a87-99d2-6172e9154040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce38120-3035-4147-aa52-2de8311995ee]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d82994e8-4261-4635-a5e2-afce96f84650 tempest-VolumesCloneTest-901999121 None] Created volume successfully. Jul 21 08:18:54 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea Jul 21 08:18:54 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:54 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" returned: 0 in 0.421s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:54 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 Jul 21 08:18:54 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:54 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061" returned: 0 in 0.484s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:54 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061 Jul 21 08:18:54 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:55 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea.5d3b332f-f5f2-4972-b04d-13a4a2ded061" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-5d3b332f-f5f2-4972-b04d-13a4a2ded061" released by "_delete_snapshot" :: held 2.253s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" released by "delete_snapshot" :: held 2.309s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Flow 'volume_create_manager' (ec5478e8-f302-4a09-879a-9fd3e18140ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38573058-0016-4b13-97fb-6ec2bdc238b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-8236013b-e7a5-45e0-b5b6-309a858eb2ca" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38573058-0016-4b13-97fb-6ec2bdc238b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-224256178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bb818f-f9f6-421d-8512-f57570f8eef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d84518cf1f4aa6978e2ad2f3bab71b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:18:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4c6aa36c-17e4-4c63-a828-86e3f3c2921d,status='creating',terminated_at=None,updated_at=2026-07-21T06:18:55Z,use_quota=True,user_id='c59977b3615d4ee38237c1659e1bc50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a17923-a328-4a01-a80a-eae17d962f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a17923-a328-4a01-a80a-eae17d962f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5d1d7-4106-4465-b961-f571ef6d1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-8236013b-e7a5-45e0-b5b6-309a858eb2ca" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Deleting offline snapshot 8236013b-e7a5-45e0-b5b6-309a858eb2ca of volume e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] snapshot_file for this snap is: volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d5d1d7-4106-4465-b961-f571ef6d1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '60bb818f-f9f6-421d-8512-f57570f8eef2', 'volume_name': 'volume-60bb818f-f9f6-421d-8512-f57570f8eef2', 'volume_size': 2, 'source_volid': '4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'source_volstatus': 'available'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77b0c90-f6c3-4a64-a1dd-a23fbf6f2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77b0c90-f6c3-4a64-a1dd-a23fbf6f2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e090c0d-9015-4162-969f-b760a7a51cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:18:55 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Volume 60bb818f-f9f6-421d-8512-f57570f8eef2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-60bb818f-f9f6-421d-8512-f57570f8eef2', 'volume_size': 2, 'source_volid': '4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'source_volstatus': 'available'} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9b8566-530d-4ea7-82e8-44fb703d459d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:55 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Cloning volume 4c6aa36c-17e4-4c63-a828-86e3f3c2921d to volume 60bb818f-f9f6-421d-8512-f57570f8eef2 Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Creating offline snapshot 03cdb6c5-c360-4051-bfc9-e9349ac3357c of volume 4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1382efa-b369-44f5-90bd-6d01a461ff9e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:55 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca Jul 21 08:18:55 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:55 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:18:55 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:55 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d6dda3-f63a-487d-852f-1503c466f63d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:56 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.499s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:56 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c 1G Jul 21 08:18:56 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:56 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae Jul 21 08:18:56 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:56 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" returned: 0 in 0.527s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:56 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca Jul 21 08:18:56 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:56 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c 1G" returned: 0 in 0.548s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:56 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:18:56 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:56 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca" returned: 0 in 0.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:56 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca Jul 21 08:18:56 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:57 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.398s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:57 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c is being set with open permissions: ugo+rw Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:57 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:18:57 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:57 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae.8236013b-e7a5-45e0-b5b6-309a858eb2ca" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-8236013b-e7a5-45e0-b5b6-309a858eb2ca" released by "_delete_snapshot" :: held 1.981s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" released by "delete_snapshot" :: held 2.050s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:18:57 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.464s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:57 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info Jul 21 08:18:57 devstack cinder-volume[87372]: WARNING cinder.quota [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1680209065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1680209065, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:18:57 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:57 devstack cinder-volume[87372]: WARNING cinder.quota [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1680209065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1680209065, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['3f5b9dac-7949-4ee7-835e-e5ca50c28281', '693a18b0-699b-46c5-86d4-7077f4b482fd', '42bd875a-b5db-48fa-9dad-f2739addf20b', 'a1e56fb5-0e8f-482a-9baf-441c1b546e7c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['205f38d9-a6fc-4d1d-af8e-b19af612099b', 'e6fe32d1-d64a-4b72-93e1-b48b88703c4c', 'f78ed97c-19da-48c6-a79e-80c596aeab49', 'be315ab7-298c-4abb-8076-0d85c5a4d67a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:18:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0fa73084-ef1c-4b75-af67-4f4fe0ad903f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot 700fe688-07e2-46dd-bf91-4b27cfcf477f: deleted successfully Jul 21 08:18:57 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:57 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info is being set with open permissions: ugo+rw Jul 21 08:18:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:57 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info Jul 21 08:18:57 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:58 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.info" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] snapshot: 03cdb6c5-c360-4051-bfc9-e9349ac3357c, volume: 60bb818f-f9f6-421d-8512-f57570f8eef2, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac77a7b-1aec-4427-95ae-ee3e8c0677c4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:58 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:18:58 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:58 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.453s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8043170-d3a9-4dbc-ba5e-974eb6962598]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:58 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:18:58 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:59 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.487s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:59 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 Jul 21 08:18:59 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" acquired by "delete_volume" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e810b2-6880-4e27-b5ab-100474d78242]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:18:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:18:59 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea Jul 21 08:18:59 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:00 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" returned: 0 in 0.690s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:00 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea Jul 21 08:19:00 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:00 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" returned: 0 in 0.662s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-285b7a8f-48aa-4d0d-a3f8-6eeb776fdeea" released by "delete_volume" :: held 1.513s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" acquired by "delete_volume" :: waited 0.060s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:01 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00f9124-4542-4ba6-9340-91185a5f8985]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:01 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae Jul 21 08:19:01 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:02 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" returned: 0 in 1.165s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:02 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae Jul 21 08:19:02 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:03 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" returned: 0 in 0.762s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-e3d4f9e0-9d45-446d-ac9f-cfe663abcaae" released by "delete_volume" :: held 2.157s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:03 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['730d5c23-1a11-4e4e-9ec7-e8d2583ab0f4'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:03 devstack cinder-volume[87372]: WARNING cinder.quota [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1680209065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1680209065, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:03 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['68f4ec48-dbfa-4d90-ab13-dc89a2926b30', 'c417b216-aa5a-47ac-b533-1c527ff3f951', 'd998ce0c-6203-466b-a212-a151402e2c03', 'bd6b276f-cff9-4690-9793-099caaf0c5fe'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (8996b8cb-f056-4b93-986d-56de8f7196a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0025c6e4-4639-4310-be7c-1c129c5d8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0025c6e4-4639-4310-be7c-1c129c5d8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637692195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32d9d78-0913-4edf-b8a0-e95ad564d23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:04Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38316996-8cac-48ba-8f3f-22ac9877a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38316996-8cac-48ba-8f3f-22ac9877a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd20ddaa-7c5b-4411-a27a-bb301f6a772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd20ddaa-7c5b-4411-a27a-bb301f6a772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32d9d78-0913-4edf-b8a0-e95ad564d23b', 'volume_name': 'volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d65bbd9-cc73-42d6-98a9-3881995995d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d65bbd9-cc73-42d6-98a9-3881995995d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f283494-e704-48a6-97cc-5b6ca11ec91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:04 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Volume c32d9d78-0913-4edf-b8a0-e95ad564d23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b', 'volume_size': 1} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=154,cinder:UPDATE=142,cinder:INSERT=38,cinder:DELETE=5 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['1e764a71-dfe1-4773-ab24-9b2cdc9ea374', '34dc87ca-c7b3-4d6d-9c01-36529c2f364e', '2e76de6b-d7f5-40e6-93f6-e30115eb96f3', '0b84a3fb-da90-4010-a90d-c6e1564c8080'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:04 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:04 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:05 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.600s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:05 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-be79dcbe-e89b-4f82-bfda-6f1d8bd9763c tempest-GroupSnapshotsTest-2114430932 None] Delete group completed successfully. Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=148,cinder:UPDATE=160,cinder:INSERT=33,cinder:DELETE=10 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (1c9b139c-7f0d-474d-b4b0-f7813919a11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6ddc5-f5ec-4437-b6d6-1bcff981e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d6ddc5-f5ec-4437-b6d6-1bcff981e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696103935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:05Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fd4727-6443-49b0-8962-e1f82754e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fd4727-6443-49b0-8962-e1f82754e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95af551a-980e-4d70-a5c1-5cd1f7751c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95af551a-980e-4d70-a5c1-5cd1f7751c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b', 'volume_name': 'volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff03060-7c99-4bf6-8bb7-e9928467c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff03060-7c99-4bf6-8bb7-e9928467c487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b842b065-6257-4998-b8ec-bbc42a11d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:05 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Volume b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b', 'volume_size': 1} Jul 21 08:19:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:06 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2" returned: 0 in 7.129s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[de470e24-c25e-456f-b198-727b26e0bd6b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:06 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:19:06 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (e3d49d82-8314-4eb2-9030-8f84106ed096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b330b61-4f21-4992-8778-ea2fdea6ce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b330b61-4f21-4992-8778-ea2fdea6ce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-350995760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fdcf5e-ff74-4758-b5bf-d146a3d381cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32409fce-0ef9-4165-8f32-647c17ace996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32409fce-0ef9-4165-8f32-647c17ace996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26db2332-20c6-4fb2-a90a-6370c70b1432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26db2332-20c6-4fb2-a90a-6370c70b1432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fdcf5e-ff74-4758-b5bf-d146a3d381cb', 'volume_name': 'volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534917e7-a134-454b-9d27-ed35d51edef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534917e7-a134-454b-9d27-ed35d51edef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7959afff-fb4f-493e-ac15-469769f096ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Volume f8fdcf5e-ff74-4758-b5bf-d146a3d381cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb', 'volume_size': 1} Jul 21 08:19:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6a821d5a-1172-4173-9473-47dd0144a787 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-1102442612: creating Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (61aabafb-886e-4736-a4cc-768000178120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304c6591-4083-4491-bc79-89b3c2a1c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304c6591-4083-4491-bc79-89b3c2a1c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-906842165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d68079-dfe4-41e4-8cc4-9b6ab52db1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b9be1c-0f12-4163-ac51-6fbe44ae3563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b9be1c-0f12-4163-ac51-6fbe44ae3563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e763b74-5e3d-4091-ad3c-e5284f32c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e763b74-5e3d-4091-ad3c-e5284f32c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d68079-dfe4-41e4-8cc4-9b6ab52db1b7', 'volume_name': 'volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede16d2-f167-4a51-9464-485afe673128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bede16d2-f167-4a51-9464-485afe673128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c531914-2631-4055-90e2-88667c215711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Volume 39d68079-dfe4-41e4-8cc4-9b6ab52db1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7', 'volume_size': 1} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6a821d5a-1172-4173-9473-47dd0144a787 tempest-GroupSnapshotsTest-2114430932 None] Group tempest-GroupSnapshotsTest-Group-1102442612: created successfully Jul 21 08:19:07 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.681s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Converted 1024.00 MB image at 143.62 MB/s Jul 21 08:19:07 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 is being set with open permissions: ugo+rw Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6a821d5a-1172-4173-9473-47dd0144a787 tempest-GroupSnapshotsTest-2114430932 None] Create group completed successfully. Jul 21 08:19:07 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 Jul 21 08:19:07 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (c6f7c5f1-3fe7-4cbe-bafe-e9f283a37c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbe8ee9-1f82-4853-9920-ff40ff268f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbe8ee9-1f82-4853-9920-ff40ff268f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359217854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7c55bf-a758-48bc-b0b0-5915551b444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca8673-06fd-48b3-91a2-dd5d72bbd7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfca8673-06fd-48b3-91a2-dd5d72bbd7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994feb7d-8d32-4b64-a3a1-26d618ba9659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994feb7d-8d32-4b64-a3a1-26d618ba9659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7c55bf-a758-48bc-b0b0-5915551b444e', 'volume_name': 'volume-db7c55bf-a758-48bc-b0b0-5915551b444e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f2d5f3-42b6-4674-9f19-519f79f94a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f2d5f3-42b6-4674-9f19-519f79f94a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75d469a-1e5f-4d31-97a1-a66d065a48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Volume db7c55bf-a758-48bc-b0b0-5915551b444e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7c55bf-a758-48bc-b0b0-5915551b444e', 'volume_size': 1} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:07 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" released by "_copy_volume_from_snapshot" :: held 9.140s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-quobyte-03cdb6c5-c360-4051-bfc9-e9349ac3357c" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-03cdb6c5-c360-4051-bfc9-e9349ac3357c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Deleting offline snapshot 03cdb6c5-c360-4051-bfc9-e9349ac3357c of volume 4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] snapshot_file for this snap is: volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d60f3-4615-40f6-8e85-c00007cc6511]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:07 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:19:07 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:07 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.367s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e904a2-f752-4531-85fb-6d73e419d741]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:07 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:19:07 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:08 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.386s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:08 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:19:08 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (9fdff307-38a5-4b36-a2f9-5a947dcfa04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4965f15-1dc8-44d0-8646-e8ccd724e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4965f15-1dc8-44d0-8646-e8ccd724e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845667283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e3e93a2-2d5d-4e85-a90b-380e7bda0276,host='devstack@QuobyteHD#QuobyteHD',id=7e0f39b5-7a70-4679-83e3-f93036da3070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:08Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ceba302-ce62-4321-a347-09656711d1d4),volume_type_id=5ceba302-ce62-4321-a347-09656711d1d4)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fed795c-a371-4a7e-bacc-603cbbdcf7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fed795c-a371-4a7e-bacc-603cbbdcf7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d444f48-3d42-405b-bfc9-a1d68ba959de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d444f48-3d42-405b-bfc9-a1d68ba959de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0f39b5-7a70-4679-83e3-f93036da3070', 'volume_name': 'volume-7e0f39b5-7a70-4679-83e3-f93036da3070', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180eaffa-b395-4815-ba11-5a90266ecc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180eaffa-b395-4815-ba11-5a90266ecc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2fe92-1170-43d3-888f-cad67b01e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Volume 7e0f39b5-7a70-4679-83e3-f93036da3070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0f39b5-7a70-4679-83e3-f93036da3070', 'volume_size': 1} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:08 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:08 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c Jul 21 08:19:08 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:08 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d.03cdb6c5-c360-4051-bfc9-e9349ac3357c" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-03cdb6c5-c360-4051-bfc9-e9349ac3357c" released by "_delete_snapshot" :: held 1.431s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.424s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.463s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637692195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32d9d78-0913-4edf-b8a0-e95ad564d23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:04Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Creating volume c32d9d78-0913-4edf-b8a0-e95ad564d23b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:08 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:08 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b 1073741824 Jul 21 08:19:08 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e090c0d-9015-4162-969f-b760a7a51cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bb818f-f9f6-421d-8512-f57570f8eef2', 'volume_size': 2, 'source_volid': '4c6aa36c-17e4-4c63-a828-86e3f3c2921d', 'source_volstatus': 'available'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87386f82-7779-4af8-a79f-d2bed1eaac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Volume volume-60bb818f-f9f6-421d-8512-f57570f8eef2 (60bb818f-f9f6-421d-8512-f57570f8eef2): created successfully Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87386f82-7779-4af8-a79f-d2bed1eaac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Flow 'volume_create_manager' (ec5478e8-f302-4a09-879a-9fd3e18140ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-32e57972-828d-44b1-a7d8-32ac08b260fb tempest-VolumesCloneTest-901999121 None] Created volume successfully. Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-60bb818f-f9f6-421d-8512-f57570f8eef2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "cinder-60bb818f-f9f6-421d-8512-f57570f8eef2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[967ad385-75ec-4eb8-a93c-8779ab6a3ed6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:09 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b 1073741824" returned: 0 in 0.507s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:09 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 Jul 21 08:19:09 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:09 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b Jul 21 08:19:09 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:09 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.733s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696103935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:05Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Creating volume b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:09 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:09 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2" returned: 0 in 0.393s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:09 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b 1073741824 Jul 21 08:19:09 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f283494-e704-48a6-97cc-5b6ca11ec91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:09 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2 Jul 21 08:19:09 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d6b37-24f6-4e50-8e87-60ad4281185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Volume volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b (c32d9d78-0913-4edf-b8a0-e95ad564d23b): created successfully Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d6b37-24f6-4e50-8e87-60ad4281185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (8996b8cb-f056-4b93-986d-56de8f7196a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d79faede-d76b-4d72-99d6-7de3ccdccce4 tempest-CreateVolumesFromImageTest-1103653475 None] Created volume successfully. Jul 21 08:19:10 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-60bb818f-f9f6-421d-8512-f57570f8eef2" returned: 0 in 0.262s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-60bb818f-f9f6-421d-8512-f57570f8eef2" released by "delete_volume" :: held 0.697s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Created reservations ['ed669530-08c3-4539-9418-ec7a6fa4cedf', '3ccee2f4-1c86-482f-b5bc-cf93eacec62c', 'dc8fefc7-a200-4810-b2f5-227e55a7b9a0', '26674039-ad73-41de-bac1-8ca5331f9fee'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:10 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b 1073741824" returned: 0 in 0.439s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:10 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:10 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:10 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b Jul 21 08:19:10 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:10 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Deleted volume successfully. Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a6734a24-de4f-46d2-a9e6-e0c4b7c2a1e0 tempest-VolumesCloneTest-901999121 None] Lock "cinder-60bb818f-f9f6-421d-8512-f57570f8eef2-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:10 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.735s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-350995760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fdcf5e-ff74-4758-b5bf-d146a3d381cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Creating volume f8fdcf5e-ff74-4758-b5bf-d146a3d381cb {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-4c6aa36c-17e4-4c63-a828-86e3f3c2921d-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:10 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb 1073741824 Jul 21 08:19:10 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b842b065-6257-4998-b8ec-bbc42a11d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b40c9-1ea4-4265-a3ce-fcd81fb77730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "cinder-4c6aa36c-17e4-4c63-a828-86e3f3c2921d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Volume volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b (b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b): created successfully Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b40c9-1ea4-4265-a3ce-fcd81fb77730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (1c9b139c-7f0d-474d-b4b0-f7813919a11d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-83a0979a-98cd-40f1-9d3e-eff10d2507f7 tempest-CreateVolumesFromImageTest-1103653475 None] Created volume successfully. Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Acquiring lock "cinder-quobyte-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c9df1-fe0e-4687-86f1-811fd69aad0d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:10 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:19:10 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:10 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb 1073741824" returned: 0 in 0.452s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:11 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb Jul 21 08:19:11 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:11 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.394s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:11 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d Jul 21 08:19:11 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:11 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" returned: 0 in 0.262s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.114s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-906842165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d68079-dfe4-41e4-8cc4-9b6ab52db1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Creating volume 39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7959afff-fb4f-493e-ac15-469769f096ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:11 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 1073741824 Jul 21 08:19:11 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730ab6d0-fa58-4688-8939-c287d5ccf487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Volume volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb (f8fdcf5e-ff74-4758-b5bf-d146a3d381cb): created successfully Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730ab6d0-fa58-4688-8939-c287d5ccf487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (e3d49d82-8314-4eb2-9030-8f84106ed096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:11 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-393363ca-c0d6-4817-b08d-c42b6d094b15 tempest-CreateVolumesFromImageTest-1103653475 None] Created volume successfully. Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "cinder-quobyte-4c6aa36c-17e4-4c63-a828-86e3f3c2921d" released by "delete_volume" :: held 0.719s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Created reservations ['656231f9-d184-45ca-8a66-d6e8af487969', '8f4ed3e7-b8d5-43cb-86c5-82751284a5cd', 'bfa9ebbe-8562-42db-9c90-034aa9215e55', 'c296817f-d42b-413b-838d-108c0b751c05'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:11 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:11 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:11 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 1073741824" returned: 0 in 0.510s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:11 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.300s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Deleted volume successfully. Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-af3eb5fc-cf78-470b-a563-9d8bde26a65a tempest-VolumesCloneTest-901999121 None] Lock "cinder-4c6aa36c-17e4-4c63-a828-86e3f3c2921d-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:11 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 Jul 21 08:19:11 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:12 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359217854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7c55bf-a758-48bc-b0b0-5915551b444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d5e1c9086d4bcdaecb9ba4d1958a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:07Z,use_quota=True,user_id='7d91e46ed77e4ca9a59ea1a5688bf626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Creating volume db7c55bf-a758-48bc-b0b0-5915551b444e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:12 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c531914-2631-4055-90e2-88667c215711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f77595-d9c8-4ea1-b686-68ae7df609a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:12 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e 1073741824 Jul 21 08:19:12 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Volume volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 (39d68079-dfe4-41e4-8cc4-9b6ab52db1b7): created successfully Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f77595-d9c8-4ea1-b686-68ae7df609a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (61aabafb-886e-4736-a4cc-768000178120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6c25ef8a-fbee-4e1d-9d12-3c679534e6ac tempest-CreateVolumesFromImageTest-1103653475 None] Created volume successfully. Jul 21 08:19:12 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e 1073741824" returned: 0 in 0.626s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:12 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e Jul 21 08:19:12 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:13 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.628s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e3e93a2-2d5d-4e85-a90b-380e7bda0276,created_at=2026-07-21T06:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845667283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e3e93a2-2d5d-4e85-a90b-380e7bda0276,host='devstack@QuobyteHD#QuobyteHD',id=7e0f39b5-7a70-4679-83e3-f93036da3070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='255ca73dc0c14eef8af3e1d233acab40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:08Z,use_quota=True,user_id='a51a3a3f567c4f92aaa13ff4d202591f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ceba302-ce62-4321-a347-09656711d1d4),volume_type_id=5ceba302-ce62-4321-a347-09656711d1d4)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Creating volume 7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75d469a-1e5f-4d31-97a1-a66d065a48a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7c55bf-a758-48bc-b0b0-5915551b444e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee30be-e543-440c-a186-860ddd73ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Volume volume-db7c55bf-a758-48bc-b0b0-5915551b444e (db7c55bf-a758-48bc-b0b0-5915551b444e): created successfully Jul 21 08:19:13 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 1073741824 Jul 21 08:19:13 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ee30be-e543-440c-a186-860ddd73ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Flow 'volume_create_manager' (c6f7c5f1-3fe7-4cbe-bafe-e9f283a37c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-adff03f4-3eae-420a-a023-01d0357cfa48 tempest-CreateVolumesFromImageTest-1103653475 None] Created volume successfully. Jul 21 08:19:13 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 1073741824" returned: 0 in 0.629s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:13 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 Jul 21 08:19:13 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-db7c55bf-a758-48bc-b0b0-5915551b444e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-db7c55bf-a758-48bc-b0b0-5915551b444e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-quobyte-db7c55bf-a758-48bc-b0b0-5915551b444e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-db7c55bf-a758-48bc-b0b0-5915551b444e" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267b660-2a4b-4505-8233-9a607aa57cdf]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:14 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070" returned: 0 in 0.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2fe92-1170-43d3-888f-cad67b01e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0f39b5-7a70-4679-83e3-f93036da3070', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf36f41-ae48-4b6e-aeb4-5e249a01c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Volume volume-7e0f39b5-7a70-4679-83e3-f93036da3070 (7e0f39b5-7a70-4679-83e3-f93036da3070): created successfully Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf36f41-ae48-4b6e-aeb4-5e249a01c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Flow 'volume_create_manager' (9fdff307-38a5-4b36-a2f9-5a947dcfa04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-64fa4b41-a2a4-4cc6-800c-5834cfaad1cb tempest-GroupSnapshotsTest-2114430932 None] Created volume successfully. Jul 21 08:19:14 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e Jul 21 08:19:14 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:14 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e" returned: 0 in 0.474s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] GroupSnapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: creating. Jul 21 08:19:14 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e Jul 21 08:19:14 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Group snapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: creating. {{(pid=87372) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Creating offline snapshot 9b4eb35b-f8df-4df6-a695-069d61b693e2 of volume 7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5e425-bdce-48e4-8612-81ba7ecf579d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:14 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 Jul 21 08:19:14 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:14 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-db7c55bf-a758-48bc-b0b0-5915551b444e" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-db7c55bf-a758-48bc-b0b0-5915551b444e" released by "delete_volume" :: held 0.815s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Created reservations ['514d2cc7-3cc7-4ef6-966d-3863d6e9dd3f', '78b85df9-85ae-46a6-9bb3-120dcb41a96c', 'd768a93f-86ba-4ae8-96b1-ab36eb34a3d5', 'd520fe69-2f19-4a84-83d5-375f0e4433ad'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:14 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:14 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:15 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:15 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 1G Jul 21 08:19:15 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-quobyte-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8627a8-4e36-4498-aa6a-739775c4f6c9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:15 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Deleted volume successfully. Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1e05567a-466d-4da0-8ea0-89b03bb72909 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-db7c55bf-a758-48bc-b0b0-5915551b444e-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:15 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 Jul 21 08:19:15 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Flow 'volume_create_manager' (5388e175-335a-4d57-813d-2d0388b76440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0285b19-a90d-4b6c-ac1d-d6476316531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0285b19-a90d-4b6c-ac1d-d6476316531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2052379006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf806ba3-5cd9-4c61-a0be-3e96f63b883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3a6693d46440fa5f5bfb41386b6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:15Z,use_quota=True,user_id='db1e6e670c534c4da501995391c50982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdd8511-0706-4599-b861-2a2755c8abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:15 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cdd8511-0706-4599-b861-2a2755c8abe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ac3ad2-f90d-4786-afdb-dc1bc66dabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 1G" returned: 0 in 0.575s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f39b5-7a70-4679-83e3-f93036da3070 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:15 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f39b5-7a70-4679-83e3-f93036da3070 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 Jul 21 08:19:15 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:15 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" returned: 0 in 0.494s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:15 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7 Jul 21 08:19:15 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ac3ad2-f90d-4786-afdb-dc1bc66dabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf806ba3-5cd9-4c61-a0be-3e96f63b883b', 'volume_name': 'volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1733f4a-0903-48c2-a8cb-5c0c8bf54ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1733f4a-0903-48c2-a8cb-5c0c8bf54ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88aa92-a338-4a42-a4fb-ed8190937223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:15 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Trying to clone bf806ba3-5cd9-4c61-a0be-3e96f63b883b from image a3f8b652-69e7-49da-931e-22bcdb879c31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:19:15 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f39b5-7a70-4679-83e3-f93036da3070 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2" returned: 0 in 0.397s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:15 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:19:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:16 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 Jul 21 08:19:16 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:16 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" returned: 0 in 0.291s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7" released by "delete_volume" :: held 0.867s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Created reservations ['d05cd510-c8d6-43a7-8c52-fc98893341d5', 'de031d2d-f657-4967-a0d6-78c51c40639f', '1ebeeeae-8c86-457f-bf4a-8a3f29c28f0b', '5ce8bb1f-a801-404c-b979-6274a1abab70'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:19:16 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Image download 20.69 MB at 20.69 MB/s Jul 21 08:19:16 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2" returned: 0 in 0.360s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16caf7e-6794-45f0-996c-14960bf2478b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:16 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info Jul 21 08:19:16 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:16 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:16 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:16 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD Jul 21 08:19:16 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:16 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info" returned: 0 in 0.336s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:16 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:16 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info Jul 21 08:19:16 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:16 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Deleted volume successfully. Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-f32689f5-2dac-44f9-a4e5-65f244218df5 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-39d68079-dfe4-41e4-8cc4-9b6ab52db1b7-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:16 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 is fetched for user db1e6e670c534c4da501995391c50982. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a69c3e-a493-44d7-9c16-9604e13667dd]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:17 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.info" returned: 0 in 0.316s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:17 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD Jul 21 08:19:17 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-36d8abe5-b6ee-4037-8f6c-64bdfbfcb5e7 tempest-GroupSnapshotsTest-2114430932 None] group_snapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: created successfully Jul 21 08:19:17 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2052379006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf806ba3-5cd9-4c61-a0be-3e96f63b883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3a6693d46440fa5f5bfb41386b6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:15Z,use_quota=True,user_id='db1e6e670c534c4da501995391c50982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Creating volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:17 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:17 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1073741824 Jul 21 08:19:17 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-quobyte-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7c2b8a-f140-4308-b28e-301bd09042c6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:17 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb Jul 21 08:19:17 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:17 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1073741824" returned: 0 in 0.598s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: deleting Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: deleting {{(pid=87372) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" returned: 0 in 0.506s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b Jul 21 08:19:18 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-9b4eb35b-f8df-4df6-a695-069d61b693e2" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:18 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb Jul 21 08:19:18 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-9b4eb35b-f8df-4df6-a695-069d61b693e2" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Deleting offline snapshot 9b4eb35b-f8df-4df6-a695-069d61b693e2 of volume 7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] snapshot_file for this snap is: volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41c9e90-cadf-407a-bec1-cbb5d1091abe]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Attempting download of a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:19:18 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 Jul 21 08:19:18 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd8b8f0-e783-4872-9dcf-c5486978d362]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" returned: 0 in 0.447s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb" released by "delete_volume" :: held 1.021s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:18 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt Jul 21 08:19:18 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Created reservations ['46e89dfc-1143-4757-814a-d2e6776b676f', 'a7b9cd46-4627-4544-ac12-cc1bb4b3352c', 'e04a5322-0371-4f4d-9bc7-52d39bbd94bf', '17b1c9fb-5cd9-4532-b62a-c56f02cceed5'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:18 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:18 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2" returned: 0 in 0.592s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e0f39b5-7a70-4679-83e3-f93036da3070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf828d-d3f8-418d-aa66-69098461f88f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:18 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt" returned: 0 in 0.492s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:19 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 Jul 21 08:19:19 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt Jul 21 08:19:19 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Deleted volume successfully. Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-20c8a24e-64b6-4fa4-a896-b152e8ffc359 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-f8fdcf5e-ff74-4758-b5bf-d146a3d381cb-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:19 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt" returned: 1 in 0.412s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_ppwxr1qt' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb38536-41a6-4829-92fd-5f541b86393d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:19 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070" returned: 0 in 0.504s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-68d30720-ca0b-4f42-92b3-3b2a12ecff8d req-b2055d92-b0cb-4354-bfed-7c8226610ce5 tempest-TestMinimumBasicScenario-1808839248 None] Terminate volume connection completed successfully. Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-68d30720-ca0b-4f42-92b3-3b2a12ecff8d req-b2055d92-b0cb-4354-bfed-7c8226610ce5 tempest-TestMinimumBasicScenario-1808839248 None] Deleting attachment a52df0a5-4337-4bf9-8698-bcce72da4fa3. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:19:19 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 Jul 21 08:19:19 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD Jul 21 08:19:19 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:19 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] a3f8b652-69e7-49da-931e-22bcdb879c31 was qcow2, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:19 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b Jul 21 08:19:19 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-quobyte-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:19 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2" returned: 0 in 0.433s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" acquired by "delete_volume" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:19 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2 Jul 21 08:19:19 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca5a0c-ab05-4f47-a680-662c45d9e8d8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:20 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b Jul 21 08:19:20 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:20 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070.9b4eb35b-f8df-4df6-a695-069d61b693e2" returned: 0 in 0.299s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-9b4eb35b-f8df-4df6-a695-069d61b693e2" released by "_delete_snapshot" :: held 2.021s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" released by "delete_snapshot" :: held 2.096s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:20 devstack cinder-volume[87372]: WARNING cinder.quota [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1219671603 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1219671603, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:20 devstack cinder-volume[87372]: WARNING cinder.quota [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1219671603 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1219671603, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['3f7fe0b4-9571-4875-bf15-9c5c461b593c', '1ee17cc3-53b1-447b-9d47-faf925bae4a9', 'bb8cdbc6-f39f-4232-93ea-49e5d8c9248f', '60e680c3-5347-42ea-9b13-ce58176dc49a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "cinder-bf954be5-2856-4945-beb4-3f8e8885e77c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "cinder-bf954be5-2856-4945-beb4-3f8e8885e77c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:20 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" returned: 0 in 0.459s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:20 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b Jul 21 08:19:20 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "cinder-quobyte-bf954be5-2856-4945-beb4-3f8e8885e77c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "cinder-quobyte-bf954be5-2856-4945-beb4-3f8e8885e77c" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7efb949a-ba6b-434a-bb03-3332613cba5f tempest-GroupSnapshotsTest-2114430932 None] group_snapshot fe08b3f3-71b4-4ed4-aff2-d9593ab7ba39: deleted successfully Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[743936fe-7481-459f-89df-db814918f274]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:20 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c Jul 21 08:19:20 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:20 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" returned: 0 in 0.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b" released by "delete_volume" :: held 0.776s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Created reservations ['463f81ae-4f89-4b03-a07c-877a1cdcc0ba', 'b6781c24-aac5-454c-b3e3-c53ae12fd849', '7d5b0f7c-1dda-4326-b983-aa573ec90a69', '8b903856-a4ff-49d3-b065-682d492d8937'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:20 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:20 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:20 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c" returned: 0 in 0.434s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-c32d9d78-0913-4edf-b8a0-e95ad564d23b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:21 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c Jul 21 08:19:21 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-c32d9d78-0913-4edf-b8a0-e95ad564d23b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "cinder-quobyte-c32d9d78-0913-4edf-b8a0-e95ad564d23b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-c32d9d78-0913-4edf-b8a0-e95ad564d23b" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c488d534-4f7c-4bcb-be65-3f79959d2c44]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:21 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.334s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Deleted volume successfully. Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-66449a6b-fa39-406a-9fad-746a9277f26a tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-b7e2fd18-e733-4bc8-9eb5-b561cf9abf3b-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:21 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf954be5-2856-4945-beb4-3f8e8885e77c" returned: 0 in 0.303s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "cinder-quobyte-bf954be5-2856-4945-beb4-3f8e8885e77c" released by "delete_volume" :: held 0.791s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:21 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b Jul 21 08:19:21 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Created reservations ['24f548d2-9482-4268-965a-d6a8254a6a66', '40fe7395-3eed-482a-b6f6-b82bdc802625', '3cb4d833-b8ae-404e-be5f-434b82a3f5f4', '855b7dd2-861c-46c4-afc4-b1bff9fb4667'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:21 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:21 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:21 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b" returned: 0 in 0.527s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:21 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b Jul 21 08:19:21 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:21 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.348s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Deleted volume successfully. Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61e917bc-4dbd-450d-beb7-6421b4a9f53c tempest-TestMinimumBasicScenario-1808839248 None] Lock "cinder-bf954be5-2856-4945-beb4-3f8e8885e77c-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:22 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c32d9d78-0913-4edf-b8a0-e95ad564d23b" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc6f80-ae56-4e51-8b5d-a021fb4f756b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-quobyte-c32d9d78-0913-4edf-b8a0-e95ad564d23b" released by "delete_volume" :: held 0.989s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:22 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" returned: 0 in 2.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_y0vre7ohdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:19:22 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Converted 112.00 MB image at 46.20 MB/s Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Created reservations ['13ca684e-3953-46c2-a33c-a91f95ecbac4', '3d8d0ab8-76b1-4181-b365-eb8db7d627f8', '99f193c2-4e26-4f6f-9faf-89604c3b2fc5', '04511880-2f9f-4daa-9fe0-349e249e830d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:22 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 Jul 21 08:19:22 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:22 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1G Jul 21 08:19:22 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:22 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:22 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:22 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070" returned: 0 in 0.619s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:22 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070 Jul 21 08:19:22 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:22 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.360s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Deleted volume successfully. Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-43238b9b-562d-4d56-a034-de3dabc6da39 tempest-CreateVolumesFromImageTest-1103653475 None] Lock "cinder-c32d9d78-0913-4edf-b8a0-e95ad564d23b-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:22 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 1G" returned: 0 in 0.647s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Downloaded image a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 for user db1e6e670c534c4da501995391c50982 is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Marking volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Copying metadata from image a3f8b652-69e7-49da-931e-22bcdb879c31 to bf806ba3-5cd9-4c61-a0be-3e96f63b883b. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:19:22 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Creating volume glance metadata for volume bf806ba3-5cd9-4c61-a0be-3e96f63b883b backed by image a3f8b652-69e7-49da-931e-22bcdb879c31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:19:23 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7e0f39b5-7a70-4679-83e3-f93036da3070" returned: 0 in 0.320s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Lock "cinder-quobyte-7e0f39b5-7a70-4679-83e3-f93036da3070" released by "delete_volume" :: held 1.042s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa88aa92-a338-4a42-a4fb-ed8190937223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849ed574-d337-4059-9af8-e87b76b8885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Volume volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b (bf806ba3-5cd9-4c61-a0be-3e96f63b883b): created successfully Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849ed574-d337-4059-9af8-e87b76b8885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Flow 'volume_create_manager' (5388e175-335a-4d57-813d-2d0388b76440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-89d6e11f-c9e3-4674-854f-2fba51c53623 tempest-VolumesExtendTest-1799966541 None] Created volume successfully. Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['fb096c27-873e-4b5d-b3c1-471f618d8501'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:23 devstack cinder-volume[87372]: WARNING cinder.quota [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1219671603 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1219671603, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Created reservations ['d39eb153-e437-46b1-b0c6-e99c16b4d82a', '986e85b4-4f61-4268-8d48-dc37bb6fc72f', '2aefc4d7-f9b8-4aa9-985f-1a189d930b3a', 'd2f9cb4c-5e4c-4d8c-8f11-6c3bd78061c8'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:23 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:23 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:23 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.361s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:23 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2fcab89d-1031-4b9b-b0c8-4509ffa79969 tempest-GroupSnapshotsTest-2114430932 None] Delete group completed successfully. Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[02331993-d532-4f49-9383-cbbc45a47673]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:24 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b Jul 21 08:19:24 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:24 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" returned: 0 in 0.461s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 2G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b 2G" returned: 0 in 0.163s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.666s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-def90c45-0999-473c-b0e9-07299ac167d0 tempest-VolumesExtendTest-1799966541 None] Extend volume completed successfully. Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-bf806ba3-5cd9-4c61-a0be-3e96f63b883b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "cinder-bf806ba3-5cd9-4c61-a0be-3e96f63b883b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-quobyte-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e6172-5781-4319-8585-fdd08ac70bed]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:26 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b Jul 21 08:19:26 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:26 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" returned: 0 in 0.473s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:26 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b Jul 21 08:19:26 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:26 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-bf806ba3-5cd9-4c61-a0be-3e96f63b883b" released by "delete_volume" :: held 0.841s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:26 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Created reservations ['4128a066-3f25-47de-a2fc-d9c2f0da388f', '4511470d-a2e7-47e9-b37d-f3aed608ce07', 'b574b15e-528f-4cfd-99a8-8623a8d93a5e', '19472540-3cdd-4584-a7a9-5b29a019eaff'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:27 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:27 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (b13c5ba7-bde8-48d7-aaaa-2374f7e8d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c4e93-9d48-4b31-8383-e6a85fa28854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c4e93-9d48-4b31-8383-e6a85fa28854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932104542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6750ec-49f0-4091-984d-43b88799ab76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:27Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d9b15b-d93a-4995-a4ea-362fd16dd29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d9b15b-d93a-4995-a4ea-362fd16dd29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0c6943-519d-4fca-a6ee-534c87764894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0c6943-519d-4fca-a6ee-534c87764894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6750ec-49f0-4091-984d-43b88799ab76', 'volume_name': 'volume-da6750ec-49f0-4091-984d-43b88799ab76', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7701ed-46fd-4518-a32b-c04fdcd7c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb7701ed-46fd-4518-a32b-c04fdcd7c26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b65a8e4-d12b-49e2-a33f-38fd13846329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:27 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume da6750ec-49f0-4091-984d-43b88799ab76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6750ec-49f0-4091-984d-43b88799ab76', 'volume_size': 1} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-932104542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6750ec-49f0-4091-984d-43b88799ab76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:27Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:27 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:27 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 1073741824 Jul 21 08:19:27 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:27 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.356s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Deleted volume successfully. Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cdf018cb-c5b9-48f9-9ee6-5a4031e7e6bb tempest-VolumesExtendTest-1799966541 None] Lock "cinder-bf806ba3-5cd9-4c61-a0be-3e96f63b883b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:27 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 1073741824" returned: 0 in 0.554s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:27 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 Jul 21 08:19:27 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:28 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76" returned: 0 in 0.325s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b65a8e4-d12b-49e2-a33f-38fd13846329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6750ec-49f0-4091-984d-43b88799ab76', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53a77e-1f0f-4950-b02c-806a6d234035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-da6750ec-49f0-4091-984d-43b88799ab76 (da6750ec-49f0-4091-984d-43b88799ab76): created successfully Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff53a77e-1f0f-4950-b02c-806a6d234035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (b13c5ba7-bde8-48d7-aaaa-2374f7e8d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d65b952a-b0ea-4efd-b50c-94c4b02585b0 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Flow 'volume_create_manager' (265f6c66-9245-45ad-ab9b-9dd868a9e313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b19aa0c-ce16-4aff-b458-0c614149034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b19aa0c-ce16-4aff-b458-0c614149034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-186456499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc22f46-b046-4284-8776-2c2f91d7b5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3a6693d46440fa5f5bfb41386b6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:29Z,use_quota=True,user_id='db1e6e670c534c4da501995391c50982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58038e5-3c60-4cf0-ad48-e89e8bd0a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58038e5-3c60-4cf0-ad48-e89e8bd0a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2dc846-e730-4d87-976a-2437b9844cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2dc846-e730-4d87-976a-2437b9844cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc22f46-b046-4284-8776-2c2f91d7b5e6', 'volume_name': 'volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7fc3d1-a4e2-4896-8471-692f59a68cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7fc3d1-a4e2-4896-8471-692f59a68cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950bc780-9cc7-4ade-ac18-b2b1bb24a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Volume 6fc22f46-b046-4284-8776-2c2f91d7b5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6', 'volume_size': 1} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-186456499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc22f46-b046-4284-8776-2c2f91d7b5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fde3a6693d46440fa5f5bfb41386b6f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:29Z,use_quota=True,user_id='db1e6e670c534c4da501995391c50982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Creating volume 6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:28 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:28 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 1073741824 Jul 21 08:19:28 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:29 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 1073741824" returned: 0 in 0.557s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:29 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:29 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:29 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.240s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950bc780-9cc7-4ade-ac18-b2b1bb24a387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2465dfb-ee83-4ead-9d89-fdde3df446d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating offline snapshot fb766f74-b539-4b9d-a26f-6f7c5b00849e of volume da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:19:29 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Volume volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 (6fc22f46-b046-4284-8776-2c2f91d7b5e6): created successfully Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2465dfb-ee83-4ead-9d89-fdde3df446d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Flow 'volume_create_manager' (265f6c66-9245-45ad-ab9b-9dd868a9e313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fe0717-3e89-4152-bb2a-597aafb5d537]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-95dc8c9f-4772-4597-bb39-29f0cac2893f tempest-VolumesExtendTest-1799966541 None] Created volume successfully. Jul 21 08:19:30 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 Jul 21 08:19:30 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:30 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76" returned: 0 in 0.442s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:30 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e 1G Jul 21 08:19:30 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:30 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e 1G" returned: 0 in 0.509s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6750ec-49f0-4091-984d-43b88799ab76 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:30 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6750ec-49f0-4091-984d-43b88799ab76 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e Jul 21 08:19:30 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4d97e690-b814-42a0-a8f8-e6bc6815b70b tempest-GroupsV314Test-599085807 None] Group tempest-GroupsV314Test-Group-681615548: creating Jul 21 08:19:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4d97e690-b814-42a0-a8f8-e6bc6815b70b tempest-GroupsV314Test-599085807 None] Group tempest-GroupsV314Test-Group-681615548: created successfully Jul 21 08:19:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4d97e690-b814-42a0-a8f8-e6bc6815b70b tempest-GroupsV314Test-599085807 None] Create group completed successfully. Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:31 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6750ec-49f0-4091-984d-43b88799ab76 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:31 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e is being set with open permissions: ugo+rw Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:31 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e Jul 21 08:19:31 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:31 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:31 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info Jul 21 08:19:31 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:31 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info" returned: 0 in 0.279s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:31 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info is being set with open permissions: ugo+rw Jul 21 08:19:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:31 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info Jul 21 08:19:31 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:32 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.info" returned: 0 in 0.282s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.037s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Creating offline snapshot 7daf5e8e-f079-440a-88f1-4826dcacc29e of volume 6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:19:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-442e2221-30ca-405d-8d96-9cfb2bf833bd tempest-CreateVolumesFromSnapshotTest-1260260440 None] Create snapshot completed successfully Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[24260191-a7a3-4f8d-9353-513345609ac4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:32 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:32 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:32 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 0.463s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:32 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e 1G Jul 21 08:19:32 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Flow 'volume_create_manager' (cb236792-0e08-45ab-8eac-7e1c07a1e3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8495a3-8760-4e09-adc4-4d976b1fdbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8495a3-8760-4e09-adc4-4d976b1fdbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567059724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7128909e-4206-42d7-83c2-4f6e261ef409,host='devstack@QuobyteHD#QuobyteHD',id=10038159-12d0-4dd9-8307-8feee95a0b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619236949ad44f8f986388b18f5eee2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:33Z,use_quota=True,user_id='0a1b4278f44e4be9870b4a37183a02c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccf1bfd5-9756-4e23-af91-eda73c09c0db),volume_type_id=ccf1bfd5-9756-4e23-af91-eda73c09c0db)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee65ea74-9fd7-4d70-9cfd-d2ee929c3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee65ea74-9fd7-4d70-9cfd-d2ee929c3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d3a9c5-a711-4831-b90b-992ea6795a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d3a9c5-a711-4831-b90b-992ea6795a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10038159-12d0-4dd9-8307-8feee95a0b86', 'volume_name': 'volume-10038159-12d0-4dd9-8307-8feee95a0b86', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a8f489-ecfc-44ce-8ac4-e3eed9803499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a8f489-ecfc-44ce-8ac4-e3eed9803499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58a4fef-c244-4097-9b92-a31d9856310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:32 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Volume 10038159-12d0-4dd9-8307-8feee95a0b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10038159-12d0-4dd9-8307-8feee95a0b86', 'volume_size': 1} Jul 21 08:19:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:33 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e 1G" returned: 0 in 0.620s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:33 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e Jul 21 08:19:33 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (a4642d7f-5759-408b-a64b-740d0dc79413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3af37d-dea0-4aa6-b2af-b7bb39c1b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3af37d-dea0-4aa6-b2af-b7bb39c1b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073992470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70cd8a5-686d-4d84-ac0c-662a2a9e090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:33Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5a904-d608-4161-a89c-f06461e287ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a5a904-d608-4161-a89c-f06461e287ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7528ed4-329e-472f-9c66-2478b2f89ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7528ed4-329e-472f-9c66-2478b2f89ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70cd8a5-686d-4d84-ac0c-662a2a9e090c', 'volume_name': 'volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab569a9-89cc-4bea-a656-66229662d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab569a9-89cc-4bea-a656-66229662d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1d219f-1fdc-4dbe-b3ec-20a0c846f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:33 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume f70cd8a5-686d-4d84-ac0c-662a2a9e090c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c', 'volume_size': 1} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:33 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:33 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e is being set with open permissions: ugo+rw Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:33 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e Jul 21 08:19:33 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (a2463b50-4956-4436-9794-b13281661086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3b7773-48f8-4a99-9626-07ade5dd24f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3b7773-48f8-4a99-9626-07ade5dd24f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17765808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d387cdad-2aa3-47b3-9433-cd3989cd1b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:34Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ded1c2-6b59-49a6-9c29-aa0d65342c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ded1c2-6b59-49a6-9c29-aa0d65342c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007f374-1e68-4e23-bc59-710c50a79a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0007f374-1e68-4e23-bc59-710c50a79a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd387cdad-2aa3-47b3-9433-cd3989cd1b4c', 'volume_name': 'volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979fb442-f199-4281-8ab9-209385d7e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979fb442-f199-4281-8ab9-209385d7e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c4755-2ba7-4497-b477-68467799c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume d387cdad-2aa3-47b3-9433-cd3989cd1b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c', 'volume_size': 1} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e" returned: 0 in 0.361s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:34 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info Jul 21 08:19:34 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (0849c0ab-78e5-4207-ba2f-81138ed4c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4546eda-b5a4-4414-8d2e-8268a56c5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4546eda-b5a4-4414-8d2e-8268a56c5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989120206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a528e9c3-fdd2-45e6-aaea-2026c734cba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:34Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f81fd-4b2f-4a19-be25-2de796453f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853f81fd-4b2f-4a19-be25-2de796453f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b797c6-31a0-4cb8-b211-2ff3e0b8b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b797c6-31a0-4cb8-b211-2ff3e0b8b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a528e9c3-fdd2-45e6-aaea-2026c734cba1', 'volume_name': 'volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c75a62-4812-4a72-8791-f20569c69e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c75a62-4812-4a72-8791-f20569c69e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92fa77c-2586-448f-b408-e58fd58f63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume a528e9c3-fdd2-45e6-aaea-2026c734cba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1', 'volume_size': 1} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:34 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info is being set with open permissions: ugo+rw Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:34 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info Jul 21 08:19:34 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:34 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.info" returned: 0 in 0.323s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7128909e-4206-42d7-83c2-4f6e261ef409,created_at=2026-07-21T06:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567059724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7128909e-4206-42d7-83c2-4f6e261ef409,host='devstack@QuobyteHD#QuobyteHD',id=10038159-12d0-4dd9-8307-8feee95a0b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619236949ad44f8f986388b18f5eee2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:33Z,use_quota=True,user_id='0a1b4278f44e4be9870b4a37183a02c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccf1bfd5-9756-4e23-af91-eda73c09c0db),volume_type_id=ccf1bfd5-9756-4e23-af91-eda73c09c0db)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Creating volume 10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:34 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:34 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 1073741824 Jul 21 08:19:34 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (6ecacff3-3f7e-4664-ab23-06d26ea30673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e57ea91-45ea-4a0f-8cac-f4e8d7a63c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e57ea91-45ea-4a0f-8cac-f4e8d7a63c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378444067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:35Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d27787-78c8-47da-8a4f-e395670b6847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d27787-78c8-47da-8a4f-e395670b6847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57355fe6-95e9-4249-8e1e-94920a679af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57355fe6-95e9-4249-8e1e-94920a679af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7', 'volume_name': 'volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c05b1d6-b8d3-42ae-9045-054433488121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c05b1d6-b8d3-42ae-9045-054433488121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f5712-3816-4e61-86a1-3d3d559a59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7', 'volume_size': 1} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d9609f43-af69-4247-8de4-6be91a6f7933 tempest-VolumesExtendTest-1799966541 None] Create snapshot completed successfully Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (f6604f2d-9212-4e74-8ea9-3f29644089a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65417be5-c3e0-4546-8ca2-0ffee81fef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65417be5-c3e0-4546-8ca2-0ffee81fef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035029268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86493337-4c8a-4884-ad82-4dad265b1b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:35Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b71b8ab-52f8-469f-8ff9-b58f73dea1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b71b8ab-52f8-469f-8ff9-b58f73dea1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f349ef-42bd-48e8-be1e-c323dbbf0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f349ef-42bd-48e8-be1e-c323dbbf0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86493337-4c8a-4884-ad82-4dad265b1b84', 'volume_name': 'volume-86493337-4c8a-4884-ad82-4dad265b1b84', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffefebe-927f-4f7f-8b1f-4452b82526dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffefebe-927f-4f7f-8b1f-4452b82526dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1354a-55af-4f05-b645-b645203ad23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume 86493337-4c8a-4884-ad82-4dad265b1b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86493337-4c8a-4884-ad82-4dad265b1b84', 'volume_size': 1} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:35 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 1073741824" returned: 0 in 0.655s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:35 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:35 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:35 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073992470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70cd8a5-686d-4d84-ac0c-662a2a9e090c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:33Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume f70cd8a5-686d-4d84-ac0c-662a2a9e090c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58a4fef-c244-4097-9b92-a31d9856310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10038159-12d0-4dd9-8307-8feee95a0b86', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8b117-7009-4bef-9c39-a96a1c81384f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:35 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c 1073741824 Jul 21 08:19:35 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Volume volume-10038159-12d0-4dd9-8307-8feee95a0b86 (10038159-12d0-4dd9-8307-8feee95a0b86): created successfully Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de8b117-7009-4bef-9c39-a96a1c81384f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Flow 'volume_create_manager' (cb236792-0e08-45ab-8eac-7e1c07a1e3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-48437cd4-f8eb-448a-9821-566084e8e82d tempest-GroupsV314Test-599085807 None] Created volume successfully. Jul 21 08:19:36 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c 1073741824" returned: 0 in 0.442s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:36 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c Jul 21 08:19:36 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:36 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.551s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17765808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d387cdad-2aa3-47b3-9433-cd3989cd1b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:34Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume d387cdad-2aa3-47b3-9433-cd3989cd1b4c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:36 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1d219f-1fdc-4dbe-b3ec-20a0c846f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:36 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c 1073741824 Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7847ad89-04b6-4d2d-8f33-2cf5ed2989b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:36 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:36 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c (f70cd8a5-686d-4d84-ac0c-662a2a9e090c): created successfully Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7847ad89-04b6-4d2d-8f33-2cf5ed2989b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (a4642d7f-5759-408b-a64b-740d0dc79413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:36 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-eeb11cd9-35dc-49ef-9fda-d29b0d68dfac tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:37 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c 1073741824" returned: 0 in 0.568s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:37 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c Jul 21 08:19:37 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:37 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" returned: 0 in 0.297s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.039s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989120206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a528e9c3-fdd2-45e6-aaea-2026c734cba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:34Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume a528e9c3-fdd2-45e6-aaea-2026c734cba1 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:37 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 1073741824 Jul 21 08:19:37 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c4755-2ba7-4497-b477-68467799c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98214a03-984c-48ff-bb65-fb19cfc54d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c (d387cdad-2aa3-47b3-9433-cd3989cd1b4c): created successfully Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98214a03-984c-48ff-bb65-fb19cfc54d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (a2463b50-4956-4436-9794-b13281661086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a894fadc-b760-47a6-8287-177bd1fe07e1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:38 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 1073741824" returned: 0 in 0.468s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:38 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 Jul 21 08:19:38 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:38 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.295s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378444067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:35Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:38 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92fa77c-2586-448f-b408-e58fd58f63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd18524-62d5-4b12-805d-27f1514a4d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:38 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 1073741824 Jul 21 08:19:38 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 (a528e9c3-fdd2-45e6-aaea-2026c734cba1): created successfully Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd18524-62d5-4b12-805d-27f1514a4d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (0849c0ab-78e5-4207-ba2f-81138ed4c046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cfc43556-2472-4c89-9778-8b9a20884470 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:38 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 1073741824" returned: 0 in 0.499s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:38 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 Jul 21 08:19:38 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:39 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" returned: 0 in 0.238s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.735s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1035029268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86493337-4c8a-4884-ad82-4dad265b1b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07c6a4b6385f407aa4b60f40e9ec5686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:19:35Z,use_quota=True,user_id='5edc7ead9e574e39b3acfc884e32add1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Creating volume 86493337-4c8a-4884-ad82-4dad265b1b84 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:19:39 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6f5712-3816-4e61-86a1-3d3d559a59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:39 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 1073741824 Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1798d45-3ab5-412c-9f5e-35250d14029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:39 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 (b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7): created successfully Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1798d45-3ab5-412c-9f5e-35250d14029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (6ecacff3-3f7e-4664-ab23-06d26ea30673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4699584c-2a95-403a-a1ab-d2b8b1a306d5 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:39 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 1073741824" returned: 0 in 0.485s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:39 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 Jul 21 08:19:39 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:39 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84" returned: 0 in 0.259s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.447s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf1354a-55af-4f05-b645-b645203ad23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86493337-4c8a-4884-ad82-4dad265b1b84', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8be98e-dc16-40d4-ac8d-40ea5897299a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d5f8a-9ee1-49f4-aaa0-cfcac588e807]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Volume volume-86493337-4c8a-4884-ad82-4dad265b1b84 (86493337-4c8a-4884-ad82-4dad265b1b84): created successfully Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8be98e-dc16-40d4-ac8d-40ea5897299a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Flow 'volume_create_manager' (f6604f2d-9212-4e74-8ea9-3f29644089a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:19:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-05371747-0d88-4eeb-b97b-0d7e5f2cf894 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created volume successfully. Jul 21 08:19:40 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:40 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:40 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 0.364s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e 2G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e 2G" returned: 0 in 0.138s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.559s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.363s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:40 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Cloning volume 10038159-12d0-4dd9-8307-8feee95a0b86 to volume 022a91f8-fb05-41e1-a875-b794e44cb94d Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Creating offline snapshot 9a7e99f8-4768-40e8-bec9-1a3292dd036d of volume 10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[800cc9d7-e284-4d1b-b946-be4e920a5dbe]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-16f5560b-f0ab-4c5d-bee7-084131eec94a tempest-VolumesExtendTest-1799966541 None] Extend volume completed successfully. Jul 21 08:19:40 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:40 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-86493337-4c8a-4884-ad82-4dad265b1b84-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-86493337-4c8a-4884-ad82-4dad265b1b84-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:41 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.438s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-86493337-4c8a-4884-ad82-4dad265b1b84" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-86493337-4c8a-4884-ad82-4dad265b1b84" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:41 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d 1G Jul 21 08:19:41 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a92be-4bb8-4e1e-b573-130a99dbc0d4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-7daf5e8e-f079-440a-88f1-4826dcacc29e-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-7daf5e8e-f079-440a-88f1-4826dcacc29e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-quobyte-7daf5e8e-f079-440a-88f1-4826dcacc29e" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-7daf5e8e-f079-440a-88f1-4826dcacc29e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Deleting offline snapshot 7daf5e8e-f079-440a-88f1-4826dcacc29e of volume 6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] snapshot_file for this snap is: volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5319c562-3012-4a14-aa38-ab02add6252b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:41 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 Jul 21 08:19:41 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:41 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e Jul 21 08:19:41 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:41 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d 1G" returned: 0 in 0.499s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10038159-12d0-4dd9-8307-8feee95a0b86 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:41 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10038159-12d0-4dd9-8307-8feee95a0b86 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:41 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:41 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84" returned: 0 in 0.508s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:41 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84 Jul 21 08:19:41 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:41 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e" returned: 0 in 0.546s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a1b430-593c-434a-a32f-5ff552ed3de5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10038159-12d0-4dd9-8307-8feee95a0b86 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.473s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:42 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-86493337-4c8a-4884-ad82-4dad265b1b84" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:42 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-86493337-4c8a-4884-ad82-4dad265b1b84" released by "delete_volume" :: held 0.970s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['8224abc6-4e91-45e7-84a6-87c76657e739', '42a021fb-ae88-49c8-b798-05a32936af4b', '240fe8ef-27ed-418d-9515-b4517dcf9324', '7e0a5eea-e2e9-4ab0-907e-8dbb096b9f8b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:42 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:42 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.393s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" acquired by "delete_volume" :: waited 0.054s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:42 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info Jul 21 08:19:42 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[751bdf42-0775-4a2d-8dfc-c8639ab1e0dd]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 0.701s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e Jul 21 08:19:42 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 Jul 21 08:19:42 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:42 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e8061fe3-9d1e-43cc-9133-10a27646fb98 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-86493337-4c8a-4884-ad82-4dad265b1b84-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:42 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:42 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:19:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:42 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info Jul 21 08:19:42 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:43 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:43 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7 Jul 21 08:19:43 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:43 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e" returned: 0 in 0.590s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:43 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.info" returned: 0 in 0.363s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Acquiring lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:43 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e Jul 21 08:19:43 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] snapshot: 9a7e99f8-4768-40e8-bec9-1a3292dd036d, volume: 022a91f8-fb05-41e1-a875-b794e44cb94d, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9dcdd-c532-4681-8903-cd7b8a99de26]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:43 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" returned: 0 in 0.414s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:43 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:43 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7" released by "delete_volume" :: held 0.991s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6.7daf5e8e-f079-440a-88f1-4826dcacc29e" returned: 0 in 0.325s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-7daf5e8e-f079-440a-88f1-4826dcacc29e" released by "_delete_snapshot" :: held 2.286s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" released by "delete_snapshot" :: held 2.322s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['93824deb-0d83-496a-b669-c3eb667343a0', '41553f09-102f-4c58-89a6-dda9894145cc', 'c823ff61-6f5e-4d30-a04e-4a4f6b11ec04', '880b1494-78e2-4ae0-8f84-d9a05c17e823'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Created reservations ['0f800211-d6b1-486d-b177-85531c61826d', 'e5030d39-baff-4bfb-b195-25c0108261f0', '1acd2aa5-bd6e-44b6-9027-d964e50b5f60', '327e4bf3-46c4-4978-bf37-c842f0629c6b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Delete snapshot completed successfully. Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-dc00e0af-f605-44e1-83ad-76e261b8e277 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-7daf5e8e-f079-440a-88f1-4826dcacc29e-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:43 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:43 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:43 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.657s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10038159-12d0-4dd9-8307-8feee95a0b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f43ddac-6217-4d77-8daf-ca6248e167af]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:44 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:44 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:44 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d79c1976-e3af-4918-9e6c-569578938114 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-b6c5daa8-0d81-41b6-9f0f-180fe6abf3c7-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:44 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.403s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:44 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d Jul 21 08:19:44 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-6fc22f46-b046-4284-8776-2c2f91d7b5e6-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-6fc22f46-b046-4284-8776-2c2f91d7b5e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-a528e9c3-fdd2-45e6-aaea-2026c734cba1-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-a528e9c3-fdd2-45e6-aaea-2026c734cba1-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190f36e-bd73-4509-b992-1d1ab239f3ac]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-a528e9c3-fdd2-45e6-aaea-2026c734cba1" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-a528e9c3-fdd2-45e6-aaea-2026c734cba1" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2375b-1023-4cab-ae81-82d40f7f5b13]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:45 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:45 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:45 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 Jul 21 08:19:45 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:45 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 1.002s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:45 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1" returned: 0 in 0.965s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:46 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6 Jul 21 08:19:46 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:46 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1 Jul 21 08:19:46 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:46 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6fc22f46-b046-4284-8776-2c2f91d7b5e6" returned: 0 in 0.761s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-quobyte-6fc22f46-b046-4284-8776-2c2f91d7b5e6" released by "delete_volume" :: held 1.878s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:46 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a528e9c3-fdd2-45e6-aaea-2026c734cba1" returned: 0 in 0.866s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-a528e9c3-fdd2-45e6-aaea-2026c734cba1" released by "delete_volume" :: held 1.929s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:46 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Created reservations ['e3ff6a4d-31d2-47f8-ac7a-604a9e323bd9', '788ba27f-6331-4a03-9ac4-c59f63fe5743', '302339e6-8f19-45ec-ad99-b1ba5c42ea5d', 'bc5aa780-aa33-45a3-b95a-1570eed028c6'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['02828da8-8605-470e-b5a9-f1eb6c0568fe', '8ef5accd-a51d-4a28-96d8-4d8ec0cdf11e', 'f657c00f-d16a-4a44-921c-4707c0742e3f', '528a34e6-3707-4239-9068-4db59b83475c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:47 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:47 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:47 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:47 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:48 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.573s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:48 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.829s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Deleted volume successfully. Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa45cdda-9a48-40a8-a6d2-e15b2db78425 tempest-VolumesExtendTest-1799966541 None] Lock "cinder-6fc22f46-b046-4284-8776-2c2f91d7b5e6-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ae80dd15-2d0c-47ba-af65-f18b5c9bf9f8 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-a528e9c3-fdd2-45e6-aaea-2026c734cba1-delete_volume" released by "delete_volume" :: held 3.707s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-d387cdad-2aa3-47b3-9433-cd3989cd1b4c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-d387cdad-2aa3-47b3-9433-cd3989cd1b4c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" acquired by "delete_volume" :: waited 0.058s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd63d12-fbd8-4a69-b646-23bc9520cd07]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:49 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c Jul 21 08:19:49 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:50 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" returned: 0 in 1.193s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:50 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c Jul 21 08:19:50 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:51 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" returned: 0 in 0.903s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-d387cdad-2aa3-47b3-9433-cd3989cd1b4c" released by "delete_volume" :: held 2.205s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:51 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d" returned: 0 in 6.842s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfaec47-6339-45aa-a0c8-e7ba28379df4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['486226e9-6571-4e0a-a29a-142e18cf8793', 'c006cb85-e54d-49c3-b6fd-c2042f39a469', '52e119c5-bcbc-4089-bbc2-dc944910fe80', '87fd4820-0dc5-4a55-9f2a-9dbd49aa2cde'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:51 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:51 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:51 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:51 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:51 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:51 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-cc556fad-78a4-4985-b3e9-26a1200113a9 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-d387cdad-2aa3-47b3-9433-cd3989cd1b4c-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:51 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.634s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:19:51 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Converted 1024.00 MB image at 149.63 MB/s Jul 21 08:19:51 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d is being set with open permissions: ugo+rw: NotImplementedError Jul 21 08:19:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:51 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d Jul 21 08:19:51 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:52 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d" returned: 0 in 0.282s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" released by "_copy_volume_from_snapshot" :: held 8.952s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Acquiring lock "cinder-quobyte-9a7e99f8-4768-40e8-bec9-1a3292dd036d" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-9a7e99f8-4768-40e8-bec9-1a3292dd036d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Deleting offline snapshot 9a7e99f8-4768-40e8-bec9-1a3292dd036d of volume 10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] snapshot_file for this snap is: volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-f70cd8a5-686d-4d84-ac0c-662a2a9e090c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d6164-2737-4848-a372-ed93bc4a8b99]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-f70cd8a5-686d-4d84-ac0c-662a2a9e090c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3f552-1264-406e-9c59-c1fc83448a5c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:52 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:52 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:52 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c Jul 21 08:19:52 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:52 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:52 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:52 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.546s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10038159-12d0-4dd9-8307-8feee95a0b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[63af257b-5d2c-4ba1-a01d-06fa0c78c10a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:52 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" returned: 0 in 0.553s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:53 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.358s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:53 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:53 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:19:53 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c Jul 21 08:19:53 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:53 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-f70cd8a5-686d-4d84-ac0c-662a2a9e090c" released by "delete_volume" :: held 0.938s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:53 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.459s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:53 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:53 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['5e698db6-5ff0-4b76-b847-4b476fa34601', 'a5905900-d903-4011-894a-6ba3e43a4dc6', '3f0564fc-45d7-48c2-8baa-81dfa35d8326', '9fadd7c4-143b-47ac-bd4f-73f06efc4f3d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:53 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:53 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:53 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.327s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-530a8de7-2542-4853-afea-b93bf75a245a tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-f70cd8a5-686d-4d84-ac0c-662a2a9e090c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:53 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.577s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:53 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d Jul 21 08:19:53 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:54 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86.9a7e99f8-4768-40e8-bec9-1a3292dd036d" returned: 0 in 0.290s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-9a7e99f8-4768-40e8-bec9-1a3292dd036d" released by "_delete_snapshot" :: held 2.023s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.766s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e4335a75-0f1e-4a83-a95f-1ccbdd70fefd tempest-GroupsV314Test-599085807 None] Create group from source-group-7128909e-4206-42d7-83c2-4f6e261ef409 completed successfully. Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-fb766f74-b539-4b9d-a26f-6f7c5b00849e-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-fb766f74-b539-4b9d-a26f-6f7c5b00849e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-fb766f74-b539-4b9d-a26f-6f7c5b00849e" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-fb766f74-b539-4b9d-a26f-6f7c5b00849e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleting offline snapshot fb766f74-b539-4b9d-a26f-6f7c5b00849e of volume da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] snapshot_file for this snap is: volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cf33e3-177e-4451-88b0-e2109e5d71c1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:54 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e Jul 21 08:19:54 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Acquiring lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" acquired by "delete_volume" :: waited 0.050s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b979d-6b63-439f-8c41-41c07ebf476a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:55 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e" returned: 0 in 0.516s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da6750ec-49f0-4091-984d-43b88799ab76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:19:55 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d Jul 21 08:19:55 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[babe9228-e330-4ab8-8ea4-07947c536adb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:55 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 Jul 21 08:19:55 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:55 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d" returned: 0 in 0.487s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:55 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d Jul 21 08:19:55 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:55 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:55 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e Jul 21 08:19:55 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:55 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-022a91f8-fb05-41e1-a875-b794e44cb94d" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-022a91f8-fb05-41e1-a875-b794e44cb94d" released by "delete_volume" :: held 0.863s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Created reservations ['b794c403-327f-4905-97e9-19d0477ee769'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:56 devstack cinder-volume[87372]: WARNING cinder.quota [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1404816357 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1404816357, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:56 devstack cinder-volume[87372]: WARNING cinder.quota [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1404816357 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1404816357, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Created reservations ['fc20a337-e98f-48a3-b8b1-1cbf1c36e5e2', '4d3ff1a7-8ac5-4ba6-8b21-df6031f2bf34', '27af779d-123b-4b6b-ac35-1a4aeae2e3c6', '63e18460-4990-4b7d-8b68-9c1ecb9d1851'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:56 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e" returned: 0 in 0.470s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:56 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:56 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:56 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e Jul 21 08:19:56 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:56 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.343s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-059c27af-b5bc-47d3-890e-d33e46f751b7 tempest-GroupsV314Test-599085807 None] Delete group completed successfully. Jul 21 08:19:56 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76.fb766f74-b539-4b9d-a26f-6f7c5b00849e" returned: 0 in 0.530s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-fb766f74-b539-4b9d-a26f-6f7c5b00849e" released by "_delete_snapshot" :: held 2.151s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" released by "delete_snapshot" :: held 2.196s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Acquiring lock "cinder-quobyte-10038159-12d0-4dd9-8307-8feee95a0b86" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-10038159-12d0-4dd9-8307-8feee95a0b86" acquired by "delete_volume" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[03394759-57b2-4d23-9083-225af0c70b61]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['ba816157-0f97-43e4-9a8d-71e6e67228ce', 'b3dedd6a-85e5-43f1-b1d3-2ebb5584f00f', '158e3c95-921f-4122-80d3-0454c5e28265', '1e2fbb2d-c407-4a65-9ccc-e4ff3e1ba38b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Delete snapshot completed successfully. Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0674a6c9-1663-4fc3-b8de-b61f69db9cf1 tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-fb766f74-b539-4b9d-a26f-6f7c5b00849e-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:57 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:57 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:57 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.459s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:57 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86 Jul 21 08:19:57 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:57 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10038159-12d0-4dd9-8307-8feee95a0b86" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Lock "cinder-quobyte-10038159-12d0-4dd9-8307-8feee95a0b86" released by "delete_volume" :: held 0.875s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-da6750ec-49f0-4091-984d-43b88799ab76-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Created reservations ['ff59c3c4-8d0e-4d93-9460-e162f38d3e1d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-da6750ec-49f0-4091-984d-43b88799ab76-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5f4773-3f07-4b17-bff2-918285bcbe8f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Created reservations ['9ae34715-8736-403d-b424-c329dffaa224', '22adbf1d-3299-457f-a888-3f91ea51d9df', '628570bb-f7c4-4840-9c0c-054d49ea450f', 'c8d6e38f-e449-409e-aebc-e181a96a76c8'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:58 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:58 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:58 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 Jul 21 08:19:58 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:58 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ab483218-83cd-4d4e-b106-6ebc3c87d517 tempest-GroupsV314Test-599085807 None] Delete group completed successfully. Jul 21 08:19:58 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76" returned: 0 in 0.610s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:58 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76 Jul 21 08:19:58 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:59 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-da6750ec-49f0-4091-984d-43b88799ab76" returned: 0 in 0.435s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-quobyte-da6750ec-49f0-4091-984d-43b88799ab76" released by "delete_volume" :: held 1.140s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Created reservations ['3aff408b-abbe-4898-86c8-538aa85e66fc', 'da42df48-d9dd-444f-af26-15990e8f0432', '837ec12d-27a9-4efb-a6c2-14fce8ac21e8', '2f48e0bd-a1a3-4303-bfc1-da751c19041f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:19:59 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:19:59 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:19:59 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.291s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:19:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Deleted volume successfully. Jul 21 08:19:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8c34bf8f-b85c-4be1-a63a-a5a314281fda tempest-CreateVolumesFromSnapshotTest-1260260440 None] Lock "cinder-da6750ec-49f0-4091-984d-43b88799ab76-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:08 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=196,cinder:UPDATE=248,cinder:DELETE=19,cinder:INSERT=58 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:INSERT=69,cinder:UPDATE=249,cinder:SELECT=181,cinder:DELETE=15 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (a15cce11-774f-4ec3-aa80-6eecda75b654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128f8846-245d-4997-91aa-411bfc8f0719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128f8846-245d-4997-91aa-411bfc8f0719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1030336172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985ae2bf-665c-449c-8bb9-65382017528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:09Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf02acf6-721d-4ffb-8ffe-5ef741bb9da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf02acf6-721d-4ffb-8ffe-5ef741bb9da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ccb9bd-7e94-48c4-b87f-be101b47aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ccb9bd-7e94-48c4-b87f-be101b47aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985ae2bf-665c-449c-8bb9-65382017528e', 'volume_name': 'volume-985ae2bf-665c-449c-8bb9-65382017528e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b46c7a3-d05e-4fd0-9124-05b3eb630ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b46c7a3-d05e-4fd0-9124-05b3eb630ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7887b3-1316-4e21-8a0f-559dbdf3c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume 985ae2bf-665c-449c-8bb9-65382017528e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985ae2bf-665c-449c-8bb9-65382017528e', 'volume_size': 1} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1030336172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985ae2bf-665c-449c-8bb9-65382017528e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:09Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating volume 985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:09 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:09 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e 1073741824 Jul 21 08:20:09 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:09 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e 1073741824" returned: 0 in 0.602s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:09 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e Jul 21 08:20:09 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:10 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e" returned: 0 in 0.300s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7887b3-1316-4e21-8a0f-559dbdf3c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985ae2bf-665c-449c-8bb9-65382017528e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3605ff3-4810-4d34-adbd-f0fbb25a58cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume volume-985ae2bf-665c-449c-8bb9-65382017528e (985ae2bf-665c-449c-8bb9-65382017528e): created successfully Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3605ff3-4810-4d34-adbd-f0fbb25a58cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (a15cce11-774f-4ec3-aa80-6eecda75b654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f7e4f18a-5de6-4dd1-bfa7-40c82aec89a4 tempest-VolumesSnapshotTestJSON-1082577965 None] Created volume successfully. Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Flow 'volume_create_manager' (df5049fe-ab21-4e04-af74-779314075746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83019047-a020-432f-bf5e-2495abb6caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83019047-a020-432f-bf5e-2495abb6caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9497cfd8-152f-46ce-aa99-8cd488d92cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2f8e6e60474813981f17a57836fcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:11Z,use_quota=True,user_id='90382cb89d8f4519b198ba16e9c708f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdc75c2-8fbb-4a34-990e-8d3ccfbaa20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdc75c2-8fbb-4a34-990e-8d3ccfbaa20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd1f6fd-c674-41dc-ae67-1a6efbe7bd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:10 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd1f6fd-c674-41dc-ae67-1a6efbe7bd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9497cfd8-152f-46ce-aa99-8cd488d92cf5', 'volume_name': 'volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5', 'volume_size': 1, 'image_id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '819632e021b9622838392e0eb2b9940d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e2f8e6e60474813981f17a57836fcff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0caad66946349ba6d397cc18e9302c27bd70becaaab2f5bb5c75e908a351345f3c775891c2aa00b1256f71de66f40da489e4a8fe2556ad142d9323407a659b', 'id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'created_at': datetime.datetime(2026, 7, 21, 6, 20, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 20, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933f24cc-706e-45c4-a0ea-acb7dc0bbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933f24cc-706e-45c4-a0ea-acb7dc0bbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785cdb9-4063-4799-8194-72b8af5056fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5', 'volume_size': 1, 'image_id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '819632e021b9622838392e0eb2b9940d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e2f8e6e60474813981f17a57836fcff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0caad66946349ba6d397cc18e9302c27bd70becaaab2f5bb5c75e908a351345f3c775891c2aa00b1256f71de66f40da489e4a8fe2556ad142d9323407a659b', 'id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'created_at': datetime.datetime(2026, 7, 21, 6, 20, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 20, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57/file', 'properties': {}}, 'image_service': } Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Trying to clone 9497cfd8-152f-46ce-aa99-8cd488d92cf5 from image f4341b77-5b86-47f0-953d-c1cee5d6fc57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Creating offline snapshot 8a49b765-82f7-4f6b-a6b1-62e1b29551f5 of volume 985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[580dae0e-a1bc-4727-bc19-03434043daa7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:20:11 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Image download 0.00 MB at 0.00 MB/s Jul 21 08:20:11 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e Jul 21 08:20:11 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea2251f-af9b-40d2-afcb-a9e6eb5bcd4c]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:11 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:11 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:12 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e" returned: 0 in 0.617s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:12 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 1G Jul 21 08:20:12 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:12 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:12 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:12 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:12 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 1 in 0.532s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Temporary image f4341b77-5b86-47f0-953d-c1cee5d6fc57 is fetched for user 90382cb89d8f4519b198ba16e9c708f6. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:20:12 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 1G" returned: 0 in 0.712s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-985ae2bf-665c-449c-8bb9-65382017528e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:12 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-985ae2bf-665c-449c-8bb9-65382017528e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 Jul 21 08:20:12 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af9850-2fe7-4c9b-b34e-9a18b58b296a]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:13 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:13 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:13 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-985ae2bf-665c-449c-8bb9-65382017528e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5" returned: 0 in 0.353s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:13 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 is being set with open permissions: ugo+rw Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:13 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 Jul 21 08:20:13 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:13 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:13 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:13 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:13 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5" returned: 0 in 0.341s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:13 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info Jul 21 08:20:13 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:13 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:20:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:14 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info" returned: 0 in 0.306s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:14 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info is being set with open permissions: ugo+rw Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:14 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info Jul 21 08:20:14 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:14 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.info" returned: 0 in 0.312s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9497cfd8-152f-46ce-aa99-8cd488d92cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2f8e6e60474813981f17a57836fcff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:11Z,use_quota=True,user_id='90382cb89d8f4519b198ba16e9c708f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Creating volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:14 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:14 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1073741824 Jul 21 08:20:14 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7123a534-a6b8-41a9-9847-aa9086f948df tempest-VolumesSnapshotTestJSON-1082577965 None] Create snapshot completed successfully Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-8a49b765-82f7-4f6b-a6b1-62e1b29551f5-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-8a49b765-82f7-4f6b-a6b1-62e1b29551f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:15 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-8a49b765-82f7-4f6b-a6b1-62e1b29551f5" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1073741824" returned: 0 in 0.816s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-8a49b765-82f7-4f6b-a6b1-62e1b29551f5" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Deleting offline snapshot 8a49b765-82f7-4f6b-a6b1-62e1b29551f5 of volume 985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] snapshot_file for this snap is: volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e00e1-a7b8-4d4f-be2d-89913bf8a160]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:15 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 Jul 21 08:20:15 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:15 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 Jul 21 08:20:15 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:15 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5" returned: 0 in 0.598s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Attempting download of f4341b77-5b86-47f0-953d-c1cee5d6fc57 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}])) to volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1349f-af89-4fc6-b161-29d2ff1bc3a7]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:16 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5" returned: 0 in 0.908s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-985ae2bf-665c-449c-8bb9-65382017528e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb0996-f8d7-4e87-8c78-64a4642eb710]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:16 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k Jul 21 08:20:16 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:16 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e Jul 21 08:20:16 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:16 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k" returned: 0 in 0.590s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:16 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k Jul 21 08:20:16 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:16 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e" returned: 0 in 0.733s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:17 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 Jul 21 08:20:17 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:17 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k" returned: 1 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4341b77-5b86-47f0-953d-c1cee5d6fc57_ugqm9u_k' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f047cbea-57be-430e-b6f2-b50b239c8b03]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:17 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:17 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:17 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5" returned: 0 in 0.605s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:17 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5 Jul 21 08:20:17 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:17 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:17 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD Jul 21 08:20:17 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:17 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e.8a49b765-82f7-4f6b-a6b1-62e1b29551f5" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-8a49b765-82f7-4f6b-a6b1-62e1b29551f5" released by "_delete_snapshot" :: held 2.825s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" released by "delete_snapshot" :: held 2.874s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['f9fd2d33-294b-48da-a99e-77124d0f0318', '547fd1fb-02bf-4260-a485-918e2379b9a9', '1e4cc01a-6be8-47a2-aea1-88bee8e6a231', '95360e23-8561-4cb6-a13f-6dd7ca2bc869'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:18 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] f4341b77-5b86-47f0-953d-c1cee5d6fc57 was raw, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:18 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 Jul 21 08:20:18 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Delete snapshot completed successfully. Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-792a96c8-8b41-4384-804d-dd407174db35 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-8a49b765-82f7-4f6b-a6b1-62e1b29551f5-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:18 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5" returned: 0 in 0.658s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4341b77-5b86-47f0-953d-c1cee5d6fc57_qr7w2f9zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:20:18 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 08:20:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:18 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1G Jul 21 08:20:18 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:19 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 1G" returned: 0 in 0.565s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Downloaded image f4341b77-5b86-47f0-953d-c1cee5d6fc57 ((None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}])) to volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Temporary image f4341b77-5b86-47f0-953d-c1cee5d6fc57 for user 90382cb89d8f4519b198ba16e9c708f6 is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Marking volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Copying metadata from image f4341b77-5b86-47f0-953d-c1cee5d6fc57 to 9497cfd8-152f-46ce-aa99-8cd488d92cf5. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Creating volume glance metadata for volume 9497cfd8-152f-46ce-aa99-8cd488d92cf5 backed by image f4341b77-5b86-47f0-953d-c1cee5d6fc57 with: {'image_id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '819632e021b9622838392e0eb2b9940d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785cdb9-4063-4799-8194-72b8af5056fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5', 'volume_size': 1, 'image_id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '819632e021b9622838392e0eb2b9940d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e2f8e6e60474813981f17a57836fcff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0caad66946349ba6d397cc18e9302c27bd70becaaab2f5bb5c75e908a351345f3c775891c2aa00b1256f71de66f40da489e4a8fe2556ad142d9323407a659b', 'id': 'f4341b77-5b86-47f0-953d-c1cee5d6fc57', 'created_at': datetime.datetime(2026, 7, 21, 6, 20, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 20, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4341b77-5b86-47f0-953d-c1cee5d6fc57/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e681de0-b474-4378-b1bd-88109fc0215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Volume volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 (9497cfd8-152f-46ce-aa99-8cd488d92cf5): created successfully Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e681de0-b474-4378-b1bd-88109fc0215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Flow 'volume_create_manager' (df5049fe-ab21-4e04-af74-779314075746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Flow 'volume_create_manager' (45e99fd3-8857-4261-a42d-22610946a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c6594-5f0c-420a-a077-5af01528d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2ca57a61-b28c-41c9-9aa1-12147a85623a tempest-VolumeImageDependencyTests-1195866667 None] Created volume successfully. Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c6594-5f0c-420a-a077-5af01528d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1332985503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19f2e47-c442-4072-b10b-87e6aab9f29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8711ea8a5ab247a0993b22fc52743517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:20Z,use_quota=True,user_id='232a9f90adf846de82e84114a1af2d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8101d52b-821c-47d1-b2b1-46ed3fbfee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8101d52b-821c-47d1-b2b1-46ed3fbfee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5297ddea-39d7-4cd2-a9f0-f4a6e647bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5297ddea-39d7-4cd2-a9f0-f4a6e647bde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19f2e47-c442-4072-b10b-87e6aab9f29f', 'volume_name': 'volume-d19f2e47-c442-4072-b10b-87e6aab9f29f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ba5de-c9e2-4055-8129-a93e79e98ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ba5de-c9e2-4055-8129-a93e79e98ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d46187-fe3b-4c54-8341-e8069cc9a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Volume d19f2e47-c442-4072-b10b-87e6aab9f29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19f2e47-c442-4072-b10b-87e6aab9f29f', 'volume_size': 1} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1332985503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19f2e47-c442-4072-b10b-87e6aab9f29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8711ea8a5ab247a0993b22fc52743517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:20Z,use_quota=True,user_id='232a9f90adf846de82e84114a1af2d6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Creating volume d19f2e47-c442-4072-b10b-87e6aab9f29f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:19 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:20 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f 1073741824 Jul 21 08:20:20 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (dab27ea1-3a88-4c74-b8de-d69ababe983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fcf526-64ca-4ab2-914a-6f370118c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fcf526-64ca-4ab2-914a-6f370118c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6142457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3cc0a7-fb4b-4882-a833-29dabf412541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:20Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17fb12e5-9486-4b8f-aa7e-e67ea73eb3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17fb12e5-9486-4b8f-aa7e-e67ea73eb3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e567722e-f3f7-42d2-8ebc-7e2c7acda3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e567722e-f3f7-42d2-8ebc-7e2c7acda3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3cc0a7-fb4b-4882-a833-29dabf412541', 'volume_name': 'volume-5b3cc0a7-fb4b-4882-a833-29dabf412541', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a3636-3f3d-4260-a05a-8ddfc283d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a3636-3f3d-4260-a05a-8ddfc283d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2294663a-f1ae-43ac-9a36-350583fb541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume 5b3cc0a7-fb4b-4882-a833-29dabf412541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3cc0a7-fb4b-4882-a833-29dabf412541', 'volume_size': 1} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:20 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f 1073741824" returned: 0 in 0.580s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:20 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f Jul 21 08:20:20 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Acquiring lock "cinder-9497cfd8-152f-46ce-aa99-8cd488d92cf5-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "cinder-9497cfd8-152f-46ce-aa99-8cd488d92cf5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:20 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-6142457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3cc0a7-fb4b-4882-a833-29dabf412541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:20Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating volume 5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Acquiring lock "cinder-quobyte-9497cfd8-152f-46ce-aa99-8cd488d92cf5" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d46187-fe3b-4c54-8341-e8069cc9a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19f2e47-c442-4072-b10b-87e6aab9f29f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:21 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 1073741824 Jul 21 08:20:21 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186cb3b-b54e-49f9-a1ce-4e23982ee714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "cinder-quobyte-9497cfd8-152f-46ce-aa99-8cd488d92cf5" acquired by "delete_volume" :: waited 0.041s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Volume volume-d19f2e47-c442-4072-b10b-87e6aab9f29f (d19f2e47-c442-4072-b10b-87e6aab9f29f): created successfully Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186cb3b-b54e-49f9-a1ce-4e23982ee714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Flow 'volume_create_manager' (45e99fd3-8857-4261-a42d-22610946a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4ff40c-69a0-44d3-97a4-4afc96a07340]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0816ec17-6ae1-4681-8987-771631e5780d tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Created volume successfully. Jul 21 08:20:21 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 Jul 21 08:20:21 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:21 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 1073741824" returned: 0 in 0.545s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:21 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:21 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:21 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5" returned: 0 in 0.522s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:21 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5 Jul 21 08:20:21 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:21 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2294663a-f1ae-43ac-9a36-350583fb541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3cc0a7-fb4b-4882-a833-29dabf412541', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37f1ab0-8cdf-4b9e-baff-ec12990a2c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 (5b3cc0a7-fb4b-4882-a833-29dabf412541): created successfully Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37f1ab0-8cdf-4b9e-baff-ec12990a2c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (dab27ea1-3a88-4c74-b8de-d69ababe983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bd814dbc-4d28-4fd5-a073-bef96b666595 tempest-VolumesSnapshotTestJSON-1082577965 None] Created volume successfully. Jul 21 08:20:21 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9497cfd8-152f-46ce-aa99-8cd488d92cf5" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "cinder-quobyte-9497cfd8-152f-46ce-aa99-8cd488d92cf5" released by "delete_volume" :: held 0.921s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Created reservations ['5bdcdc08-b2d2-4c8e-b0cc-07a9de099ebc', 'afc7b03b-9dd9-403e-9d9a-58d79ddf2985', '33d73d25-360e-4fa0-a98c-49dd6edb3682', 'bc2e4c24-5c0c-440b-81d3-358a31542074'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:22 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:22 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:22 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Deleted volume successfully. Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1e862b4-6d15-4e1d-9cf7-4bc29b83ca07 tempest-VolumeImageDependencyTests-1195866667 None] Lock "cinder-9497cfd8-152f-46ce-aa99-8cd488d92cf5-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Creating offline snapshot 65c6da41-23f0-47ab-85ca-a5a7198eaea1 of volume 5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff94cc-db79-4ec7-a47a-27b1e37bbbf5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:22 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:22 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Acquiring lock "cinder-d19f2e47-c442-4072-b10b-87e6aab9f29f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "cinder-d19f2e47-c442-4072-b10b-87e6aab9f29f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Acquiring lock "cinder-quobyte-d19f2e47-c442-4072-b10b-87e6aab9f29f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "cinder-quobyte-d19f2e47-c442-4072-b10b-87e6aab9f29f" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdecb018-96fc-46fe-bee7-48ebc5b71dab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.402s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 1G Jul 21 08:20:23 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:23 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f Jul 21 08:20:23 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:23 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f Jul 21 08:20:23 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:23 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 1G" returned: 0 in 0.495s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:23 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:23 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d19f2e47-c442-4072-b10b-87e6aab9f29f" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "cinder-quobyte-d19f2e47-c442-4072-b10b-87e6aab9f29f" released by "delete_volume" :: held 0.786s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Created reservations ['ae1c869b-7a34-4971-9671-a743fc6c9ff6', 'f07ed10f-1b02-4ee0-a1c8-c7eb866f4e6d', '65ab4dd0-f2f1-4379-b9e3-1c780445b48d', '95bbcf67-258c-4682-93a1-9660cfcaf5ba'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.388s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:23 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 is being set with open permissions: ugo+rw Jul 21 08:20:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:23 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:23 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:24 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:24 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:24 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Deleted volume successfully. Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92c1dab-61c6-46a5-89b1-f7da392ef698 tempest-VolumeQuotasNegativeTestJSON-1536325042 None] Lock "cinder-d19f2e47-c442-4072-b10b-87e6aab9f29f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:24 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.471s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:24 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info Jul 21 08:20:24 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:24 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info" returned: 0 in 0.362s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info is being set with open permissions: ugo+rw Jul 21 08:20:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:24 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info Jul 21 08:20:24 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:25 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.info" returned: 0 in 0.395s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.677s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b88e666a-bf2c-4390-9642-00a2d8e7caab tempest-VolumesSnapshotTestJSON-1082577965 None] Create snapshot completed successfully Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (ab5cf070-c979-478d-83ed-684d8d079749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f68e02-6d27-47a0-b8e6-01e1bfd6511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f68e02-6d27-47a0-b8e6-01e1bfd6511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1995931588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eaae338-699e-4d9d-96ec-da588e824451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=65c6da41-23f0-47ab-85ca-a5a7198eaea1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:27Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a74225-f797-4ee1-ab7b-1500e088a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a74225-f797-4ee1-ab7b-1500e088a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e5829-b7e6-4100-9268-d5339f01d597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7e5829-b7e6-4100-9268-d5339f01d597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6eaae338-699e-4d9d-96ec-da588e824451', 'volume_name': 'volume-6eaae338-699e-4d9d-96ec-da588e824451', 'volume_size': 2, 'snapshot_id': '65c6da41-23f0-47ab-85ca-a5a7198eaea1'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ee4cc6-5054-40aa-a6ce-4fdfdca78011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ee4cc6-5054-40aa-a6ce-4fdfdca78011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8cbb5d-8fbc-46d7-86ab-ad6cb361f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume 6eaae338-699e-4d9d-96ec-da588e824451: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6eaae338-699e-4d9d-96ec-da588e824451', 'volume_size': 2, 'snapshot_id': '65c6da41-23f0-47ab-85ca-a5a7198eaea1'} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1-6eaae338-699e-4d9d-96ec-da588e824451" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1-6eaae338-699e-4d9d-96ec-da588e824451" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating volume 6eaae338-699e-4d9d-96ec-da588e824451 from snapshot 65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] snapshot: 65c6da41-23f0-47ab-85ca-a5a7198eaea1, volume: 6eaae338-699e-4d9d-96ec-da588e824451, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[676bf688-374d-4c91-9da3-f79ec8abbdcc]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:27 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:27 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:27 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.600s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b3cc0a7-fb4b-4882-a833-29dabf412541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a0448-857a-4622-b324-c115fd689729]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:27 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:27 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:28 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:28 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 Jul 21 08:20:28 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Flow 'volume_create_manager' (b9fe61fd-dbdf-4ba2-a8c5-f89440d8a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22638f08-b4c0-4bd2-ba0e-000955a7c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22638f08-b4c0-4bd2-ba0e-000955a7c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661744388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e96b1-a3ab-4f13-863b-fb9b4abebcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5a5652ba5545af96442ce1d15e5a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:29Z,use_quota=True,user_id='b8127665c35e4aaa99299805bfa10859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b17dc-0be3-4b31-935b-5861b84ea7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241b17dc-0be3-4b31-935b-5861b84ea7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7950686c-8a40-4a2f-bacc-05e490147d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7950686c-8a40-4a2f-bacc-05e490147d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87e96b1-a3ab-4f13-863b-fb9b4abebcf2', 'volume_name': 'volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e52cf-1fdc-45d4-8ac0-b3b27d50e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e52cf-1fdc-45d4-8ac0-b3b27d50e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf399e4-9715-4258-bf07-6606ea59088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Volume d87e96b1-a3ab-4f13-863b-fb9b4abebcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2', 'volume_size': 1} Jul 21 08:20:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:33 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451" returned: 0 in 5.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b29dd7d-496a-4acb-a9f8-75caa383e0e8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:33 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:33 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Flow 'volume_create_manager' (98a92038-1d42-4f6a-8dbb-9258a829f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412e4bae-f6e5-4830-8454-4226d3c91ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412e4bae-f6e5-4830-8454-4226d3c91ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2043212871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3f613f-663c-4168-b8d5-2ca229ee27e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdac74513cb4325b537bd83ed946905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:34Z,use_quota=True,user_id='420aaf620e5d486dbd0557a5c9123785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e235a-0dd1-4903-b9e9-812991d0ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3e235a-0dd1-4903-b9e9-812991d0ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9928040d-700f-4807-9c15-3338b4758f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9928040d-700f-4807-9c15-3338b4758f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3f613f-663c-4168-b8d5-2ca229ee27e1', 'volume_name': 'volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699169cd-7541-4447-a565-7edb3ad07dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699169cd-7541-4447-a565-7edb3ad07dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbdae4a-1da8-4ffb-9718-8b843202a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Volume 9f3f613f-663c-4168-b8d5-2ca229ee27e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1', 'volume_size': 1} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:34 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.609s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:20:34 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Converted 1024.00 MB image at 192.55 MB/s Jul 21 08:20:34 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 is being set with open permissions: ugo+rw Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:34 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 Jul 21 08:20:34 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:34 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" released by "_copy_volume_from_snapshot" :: held 7.446s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1-6eaae338-699e-4d9d-96ec-da588e824451" released by "_create_volume_from_snapshot" :: held 7.491s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.544s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.516s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661744388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87e96b1-a3ab-4f13-863b-fb9b4abebcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5a5652ba5545af96442ce1d15e5a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:29Z,use_quota=True,user_id='b8127665c35e4aaa99299805bfa10859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Creating volume d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:34 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:34 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 1073741824 Jul 21 08:20:34 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8cbb5d-8fbc-46d7-86ab-ad6cb361f407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eaae338-699e-4d9d-96ec-da588e824451', 'volume_size': 2, 'snapshot_id': '65c6da41-23f0-47ab-85ca-a5a7198eaea1'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005fa274-27eb-468e-8903-45b19cda5d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume volume-6eaae338-699e-4d9d-96ec-da588e824451 (6eaae338-699e-4d9d-96ec-da588e824451): created successfully Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005fa274-27eb-468e-8903-45b19cda5d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (ab5cf070-c979-478d-83ed-684d8d079749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2b241b56-e61f-4989-96a9-dbaf5bf27a47 tempest-VolumesSnapshotTestJSON-1082577965 None] Created volume successfully. Jul 21 08:20:34 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 1073741824" returned: 0 in 0.421s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:34 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 Jul 21 08:20:34 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:35 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" returned: 0 in 0.243s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2043212871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3f613f-663c-4168-b8d5-2ca229ee27e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbdac74513cb4325b537bd83ed946905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:34Z,use_quota=True,user_id='420aaf620e5d486dbd0557a5c9123785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Creating volume 9f3f613f-663c-4168-b8d5-2ca229ee27e1 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:35 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf399e4-9715-4258-bf07-6606ea59088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:35 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 1073741824 Jul 21 08:20:35 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d78b2a8-ef26-4d01-91c5-e29b5e4103e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Volume volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 (d87e96b1-a3ab-4f13-863b-fb9b4abebcf2): created successfully Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d78b2a8-ef26-4d01-91c5-e29b5e4103e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Flow 'volume_create_manager' (b9fe61fd-dbdf-4ba2-a8c5-f89440d8a6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-02f7c30e-891b-48cf-b663-f379d61142cc tempest-ProjectReaderTests-514993510 None] Created volume successfully. Jul 21 08:20:35 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 1073741824" returned: 0 in 0.420s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Acquiring lock "cinder-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "cinder-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:35 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 Jul 21 08:20:35 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-6eaae338-699e-4d9d-96ec-da588e824451-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Acquiring lock "cinder-quobyte-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-6eaae338-699e-4d9d-96ec-da588e824451-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "cinder-quobyte-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b389861-a770-4575-bafd-44acaf2704e3]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c3242-fa1e-4029-a098-8a6ded14662b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:35 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 Jul 21 08:20:35 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:35 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbdae4a-1da8-4ffb-9718-8b843202a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541c9c81-3308-496f-af81-7cef4ee6491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:35 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 Jul 21 08:20:35 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Volume volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 (9f3f613f-663c-4168-b8d5-2ca229ee27e1): created successfully Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541c9c81-3308-496f-af81-7cef4ee6491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Flow 'volume_create_manager' (98a92038-1d42-4f6a-8dbb-9258a829f978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-fccb5e71-c606-415c-bcf0-3262c44c1c95 tempest-VolumesServicesTestJSON-342440636 None] Created volume successfully. Jul 21 08:20:36 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:36 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2 Jul 21 08:20:36 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:36 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451" returned: 0 in 0.377s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:36 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451 Jul 21 08:20:36 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:36 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "cinder-quobyte-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2" released by "delete_volume" :: held 0.717s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:36 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6eaae338-699e-4d9d-96ec-da588e824451" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-6eaae338-699e-4d9d-96ec-da588e824451" released by "delete_volume" :: held 0.695s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Created reservations ['bf070d55-3453-4206-b621-03ce67c76111', '07f35342-deeb-471a-92b9-a5e0463676ec', '22a25c83-e88b-4e5e-9960-b418e3ad01e0', '5054a96e-0d49-4f0f-b65b-94e267d45e99'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['d7ce9a99-6d75-465f-9e2d-840c3088066d', '7ec3a7ca-ac8f-4857-ad7e-eb133da893ba', '26a870e4-dd20-4f0f-9d03-c82bcdc8d9b0', '7fd0c046-626a-4445-bbde-b153a95f9e51'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:36 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:36 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:36 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:36 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:36 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.332s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:36 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Deleted volume successfully. Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-65c6da41-23f0-47ab-85ca-a5a7198eaea1-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:36 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:36 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Deleted volume successfully. Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d9f62117-5683-4606-a43b-221e9dcd8f1d tempest-ProjectReaderTests-514993510 None] Lock "cinder-d87e96b1-a3ab-4f13-863b-fb9b4abebcf2-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-65c6da41-23f0-47ab-85ca-a5a7198eaea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4570aa4a-716d-4c93-b096-8f1aea75603d tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-6eaae338-699e-4d9d-96ec-da588e824451-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Deleting offline snapshot 65c6da41-23f0-47ab-85ca-a5a7198eaea1 of volume 5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] snapshot_file for this snap is: volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a26e5-8d61-4dec-8bf7-887a443e0863]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:37 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:37 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Acquiring lock "cinder-9f3f613f-663c-4168-b8d5-2ca229ee27e1-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "cinder-9f3f613f-663c-4168-b8d5-2ca229ee27e1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Acquiring lock "cinder-quobyte-9f3f613f-663c-4168-b8d5-2ca229ee27e1" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "cinder-quobyte-9f3f613f-663c-4168-b8d5-2ca229ee27e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc136c-1521-491b-a2b7-b1e66c1a1c9f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:37 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Flow 'volume_create_manager' (8f9e375c-40fa-4d42-9cd9-89315f8b8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b263eee8-8479-4c39-a287-6a24c7811eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.555s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b3cc0a7-fb4b-4882-a833-29dabf412541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b263eee8-8479-4c39-a287-6a24c7811eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021787349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2b205e-e31a-41fd-b2b7-7de536d02b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5a5652ba5545af96442ce1d15e5a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:37Z,use_quota=True,user_id='b8127665c35e4aaa99299805bfa10859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255740ce-26bc-47d9-8f3e-0f18ebfcac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255740ce-26bc-47d9-8f3e-0f18ebfcac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7ac5e4-0ec5-4607-8628-424798328fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7ac5e4-0ec5-4607-8628-424798328fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2b205e-e31a-41fd-b2b7-7de536d02b7c', 'volume_name': 'volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:37 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 Jul 21 08:20:37 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ce83a-3742-4a38-802c-46637e1791e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ce83a-3742-4a38-802c-46637e1791e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85795f4e-87fd-4cef-b5bd-8b25c4bcdf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:37 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Volume 1f2b205e-e31a-41fd-b2b7-7de536d02b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c', 'volume_size': 1} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021787349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2b205e-e31a-41fd-b2b7-7de536d02b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c5a5652ba5545af96442ce1d15e5a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:37Z,use_quota=True,user_id='b8127665c35e4aaa99299805bfa10859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Creating volume 1f2b205e-e31a-41fd-b2b7-7de536d02b7c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a16b10-ec90-4ee4-8067-eb6d806d737b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:37 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c 1073741824 Jul 21 08:20:37 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:37 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:37 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1" returned: 0 in 0.467s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:38 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1 Jul 21 08:20:38 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.440s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:38 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c 1073741824" returned: 0 in 0.498s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:38 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c Jul 21 08:20:38 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9f3f613f-663c-4168-b8d5-2ca229ee27e1" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "cinder-quobyte-9f3f613f-663c-4168-b8d5-2ca229ee27e1" released by "delete_volume" :: held 0.853s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Created reservations ['14e011f0-bcbe-431c-9a83-abfe04c8d37d', 'dd75d382-bb6b-4e43-89f2-945434d29549', '713a64d3-dc4c-47b6-9193-4e190e32e8a5', '844ada39-4b76-4f7c-a8bc-2ae25ecb599a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:38 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:38 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.467s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:38 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" returned: 0 in 0.401s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:38 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1 Jul 21 08:20:38 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85795f4e-87fd-4cef-b5bd-8b25c4bcdf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde06cbf-c7bb-4cf3-8c46-05c5f967028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Volume volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c (1f2b205e-e31a-41fd-b2b7-7de536d02b7c): created successfully Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde06cbf-c7bb-4cf3-8c46-05c5f967028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Flow 'volume_create_manager' (8f9e375c-40fa-4d42-9cd9-89315f8b8016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7b377a5d-5621-42f9-a9c4-76a9d8734da8 tempest-ProjectReaderTests-514993510 None] Created volume successfully. Jul 21 08:20:38 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Deleted volume successfully. Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b1c21ceb-2bd9-4d28-8e42-adb6b007c93c tempest-VolumesServicesTestJSON-342440636 None] Lock "cinder-9f3f613f-663c-4168-b8d5-2ca229ee27e1-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:38 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541.65c6da41-23f0-47ab-85ca-a5a7198eaea1" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-65c6da41-23f0-47ab-85ca-a5a7198eaea1" released by "_delete_snapshot" :: held 1.912s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" released by "delete_snapshot" :: held 1.942s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['5a86ef07-d574-4c05-b6bf-121d8541c6fc', 'f7e2e9c1-61bb-4d85-8453-0bd85a65fe83', '28067a5b-4a5c-4a19-a041-2a7bda2e2df6', '7d4902e6-f1b3-4c29-8053-8badbda7baee'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Delete snapshot completed successfully. Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2cb5b541-f55a-4578-a1ae-04c16d8ce447 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-65c6da41-23f0-47ab-85ca-a5a7198eaea1-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-5b3cc0a7-fb4b-4882-a833-29dabf412541-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-5b3cc0a7-fb4b-4882-a833-29dabf412541-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b2cd66-4130-4d24-88e9-8c7bde63b151]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:39 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:39 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Acquiring lock "cinder-1f2b205e-e31a-41fd-b2b7-7de536d02b7c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "cinder-1f2b205e-e31a-41fd-b2b7-7de536d02b7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Acquiring lock "cinder-quobyte-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "cinder-quobyte-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:39 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a46620-6124-4aae-aead-ead280d45876]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:39 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541 Jul 21 08:20:39 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:39 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c Jul 21 08:20:39 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:40 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5b3cc0a7-fb4b-4882-a833-29dabf412541" returned: 0 in 0.311s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-5b3cc0a7-fb4b-4882-a833-29dabf412541" released by "delete_volume" :: held 0.818s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['83b82593-45d6-4a70-8ae3-37828ada8175', '478e54c3-e42f-401d-ba4a-0722e9b97b39', 'ed0127bc-a0a3-40c5-8fc6-0a63e9df7237', '6e47930a-7763-4128-b95c-c361a6825027'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:40 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" returned: 0 in 0.482s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:40 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:40 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:40 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:40 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:40 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.305s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Deleted volume successfully. Jul 21 08:20:40 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" returned: 0 in 0.381s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "cinder-quobyte-1f2b205e-e31a-41fd-b2b7-7de536d02b7c" released by "delete_volume" :: held 0.938s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08068d73-ecd2-4c94-acff-05933bc231e1 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-5b3cc0a7-fb4b-4882-a833-29dabf412541-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Created reservations ['a5a43010-f0c5-4218-a7ec-dc04c280b953', '28e68d8f-10c9-4800-9e4b-e08b24a7ce3f', '769c47d2-1dc5-42ed-8503-846211ccca16', '7249356c-941b-4af5-9c14-f82cff3d0aa2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:40 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:40 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (9229498a-4491-4be7-86d4-9687ab66afb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609c8e9b-a1fa-4b79-8f70-db7717494edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (609c8e9b-a1fa-4b79-8f70-db7717494edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-117375282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5210117-91ac-400a-8b69-7013dbe78d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:41Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1f8db1-7693-4a4a-a755-7396a6faad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1f8db1-7693-4a4a-a755-7396a6faad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ae82b7-0439-4141-91e8-dcf2b644f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ae82b7-0439-4141-91e8-dcf2b644f047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5210117-91ac-400a-8b69-7013dbe78d94', 'volume_name': 'volume-f5210117-91ac-400a-8b69-7013dbe78d94', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a561780-e74d-4247-90b8-b3099cb5f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a561780-e74d-4247-90b8-b3099cb5f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195f3102-7fd6-4d17-ba0c-f30537523784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume f5210117-91ac-400a-8b69-7013dbe78d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5210117-91ac-400a-8b69-7013dbe78d94', 'volume_size': 1} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-117375282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5210117-91ac-400a-8b69-7013dbe78d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:41Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating volume f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:41 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.526s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Deleted volume successfully. Jul 21 08:20:41 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 1073741824 Jul 21 08:20:41 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e7c44afa-94a3-4f43-8240-5cc669c12b99 tempest-ProjectReaderTests-514993510 None] Lock "cinder-1f2b205e-e31a-41fd-b2b7-7de536d02b7c-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Flow 'volume_create_manager' (e7818608-e17f-4d4c-b5a4-7a289a873041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc291c53-fe2d-4195-897a-fcd6cd57bb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc291c53-fe2d-4195-897a-fcd6cd57bb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-73345990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383eb44f-3242-49c5-87ca-0dd731a4b862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e0bb4ef0f54c149b1fea57b6243d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:42Z,use_quota=True,user_id='e26a27f5b5d14a3cb42653fd4117ed8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e094767-9184-4baf-8800-64df05bebef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e094767-9184-4baf-8800-64df05bebef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89bbaa-398f-4f20-b56f-4b243ede95b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89bbaa-398f-4f20-b56f-4b243ede95b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383eb44f-3242-49c5-87ca-0dd731a4b862', 'volume_name': 'volume-383eb44f-3242-49c5-87ca-0dd731a4b862', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c51a0f-4343-4b8a-9522-21e47578cecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c51a0f-4343-4b8a-9522-21e47578cecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a56d59-c512-4f18-98ed-135f989ad49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Volume 383eb44f-3242-49c5-87ca-0dd731a4b862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383eb44f-3242-49c5-87ca-0dd731a4b862', 'volume_size': 1} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:41 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 1073741824" returned: 0 in 0.522s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:41 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:20:41 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:42 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-73345990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383eb44f-3242-49c5-87ca-0dd731a4b862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e0bb4ef0f54c149b1fea57b6243d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:42Z,use_quota=True,user_id='e26a27f5b5d14a3cb42653fd4117ed8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Creating volume 383eb44f-3242-49c5-87ca-0dd731a4b862 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:42 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195f3102-7fd6-4d17-ba0c-f30537523784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5210117-91ac-400a-8b69-7013dbe78d94', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c95b03-1723-4adc-9923-604220163aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:42 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 1073741824 Jul 21 08:20:42 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:42 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume volume-f5210117-91ac-400a-8b69-7013dbe78d94 (f5210117-91ac-400a-8b69-7013dbe78d94): created successfully Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c95b03-1723-4adc-9923-604220163aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (9229498a-4491-4be7-86d4-9687ab66afb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2f1924ee-51df-4320-9882-f08c7cc63a48 tempest-VolumesSnapshotTestJSON-1082577965 None] Created volume successfully. Jul 21 08:20:42 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 1073741824" returned: 0 in 0.537s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:42 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 Jul 21 08:20:42 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:43 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a56d59-c512-4f18-98ed-135f989ad49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383eb44f-3242-49c5-87ca-0dd731a4b862', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d101d0-69e1-40ee-a3b9-2d15d51fcdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:43 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Volume volume-383eb44f-3242-49c5-87ca-0dd731a4b862 (383eb44f-3242-49c5-87ca-0dd731a4b862): created successfully Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d101d0-69e1-40ee-a3b9-2d15d51fcdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Flow 'volume_create_manager' (e7818608-e17f-4d4c-b5a4-7a289a873041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3dbdc7e2-4f5f-426b-a522-e3b2b00d6b13 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Created volume successfully. Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating offline snapshot f19cf334-25be-4339-90c6-1eb0a0f72e88 of volume f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb44fc1f-604b-4092-be82-bba870afd799]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:43 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:20:43 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:44 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.474s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:44 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 1G Jul 21 08:20:44 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a8d97163-8bf2-4504-8ed8-f6900447ba54 req-314cc6d1-b5fd-49aa-b224-0a70e783286c tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:44 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 1G" returned: 0 in 0.618s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5210117-91ac-400a-8b69-7013dbe78d94 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:44 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5210117-91ac-400a-8b69-7013dbe78d94 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:44 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:45 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5210117-91ac-400a-8b69-7013dbe78d94 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.318s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:45 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 is being set with open permissions: ugo+rw Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:45 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:45 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:45 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:45 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info Jul 21 08:20:45 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Flow 'volume_create_manager' (5c190b03-02a1-4e56-a5c0-5c7bcb620c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaff4822-fd60-4420-9a6d-4051ecb741da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaff4822-fd60-4420-9a6d-4051ecb741da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-383384771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7478b1b8-82af-4a40-8f3d-f854620accce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9d3791dbd94f498bf22adc87957132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:45Z,use_quota=True,user_id='5ca24d4ff4b849f1892e00cf73ea78b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f50781-1cd7-45e0-ac23-439348163827),volume_type_id=a9f50781-1cd7-45e0-ac23-439348163827)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73783b96-cba0-4039-b347-6c1ba23b1d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73783b96-cba0-4039-b347-6c1ba23b1d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef454c99-9114-49ac-a601-ef3fb35908d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef454c99-9114-49ac-a601-ef3fb35908d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7478b1b8-82af-4a40-8f3d-f854620accce', 'volume_name': 'volume-7478b1b8-82af-4a40-8f3d-f854620accce', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3715855e-e662-4bb0-97fd-0be89cff7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3715855e-e662-4bb0-97fd-0be89cff7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08080ade-54f7-408a-ade4-6bb7b799b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:45 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Volume 7478b1b8-82af-4a40-8f3d-f854620accce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7478b1b8-82af-4a40-8f3d-f854620accce', 'volume_size': 1} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:45 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:45 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info is being set with open permissions: ugo+rw Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:45 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info Jul 21 08:20:45 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:45 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.info" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a8d97163-8bf2-4504-8ed8-f6900447ba54 req-314cc6d1-b5fd-49aa-b224-0a70e783286c tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.252s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a8d97163-8bf2-4504-8ed8-f6900447ba54 req-314cc6d1-b5fd-49aa-b224-0a70e783286c tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-383384771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7478b1b8-82af-4a40-8f3d-f854620accce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef9d3791dbd94f498bf22adc87957132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:45Z,use_quota=True,user_id='5ca24d4ff4b849f1892e00cf73ea78b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9f50781-1cd7-45e0-ac23-439348163827),volume_type_id=a9f50781-1cd7-45e0-ac23-439348163827)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Creating volume 7478b1b8-82af-4a40-8f3d-f854620accce {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:45 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e81738eb-f3bb-408d-ac70-f75925127be9 tempest-VolumesSnapshotTestJSON-1082577965 None] Create snapshot completed successfully Jul 21 08:20:45 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce 1073741824 Jul 21 08:20:45 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-a8d97163-8bf2-4504-8ed8-f6900447ba54 req-314cc6d1-b5fd-49aa-b224-0a70e783286c tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-383eb44f-3242-49c5-87ca-0dd731a4b862', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69ad551e-f1c9-45d6-9bd5-57d1f1fadfd6', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:20:46 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a8d97163-8bf2-4504-8ed8-f6900447ba54 req-314cc6d1-b5fd-49aa-b224-0a70e783286c tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] attachment_update completed successfully. Jul 21 08:20:46 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce 1073741824" returned: 0 in 0.605s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:46 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce Jul 21 08:20:46 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:46 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce" returned: 0 in 0.334s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08080ade-54f7-408a-ade4-6bb7b799b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7478b1b8-82af-4a40-8f3d-f854620accce', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1accf1-6391-4912-9570-b11fc22a557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:46 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Volume volume-7478b1b8-82af-4a40-8f3d-f854620accce (7478b1b8-82af-4a40-8f3d-f854620accce): created successfully Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1accf1-6391-4912-9570-b11fc22a557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Flow 'volume_create_manager' (5c190b03-02a1-4e56-a5c0-5c7bcb620c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bbf20bec-e759-4a3f-9264-2d8281b86b15 tempest-VolumeTypesAccessTest-418181861 None] Created volume successfully. Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (536697e8-4816-4db6-8216-0c6f8bfac5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd82af-abe6-4b48-bdb5-f30be322b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebd82af-abe6-4b48-bdb5-f30be322b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1325054161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa278193-87a7-4107-8f9d-f2b0a1d8f7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='197400b36a9b4028860dc4d51baae38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f19cf334-25be-4339-90c6-1eb0a0f72e88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:20:47Z,use_quota=True,user_id='cfcaec02f09049fea3d60596c8e2937d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9dd580-753f-4adb-a24d-afe4a6439c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9dd580-753f-4adb-a24d-afe4a6439c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f7fd99-ccf9-4590-903f-5c31fae8706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f7fd99-ccf9-4590-903f-5c31fae8706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa278193-87a7-4107-8f9d-f2b0a1d8f7b2', 'volume_name': 'volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2', 'volume_size': 1, 'snapshot_id': 'f19cf334-25be-4339-90c6-1eb0a0f72e88'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d510952-6c5e-43e2-9194-8b6f9ae76156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d510952-6c5e-43e2-9194-8b6f9ae76156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534bee8c-759b-4faa-a479-8e821d7c7a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:47 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume aa278193-87a7-4107-8f9d-f2b0a1d8f7b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2', 'volume_size': 1, 'snapshot_id': 'f19cf334-25be-4339-90c6-1eb0a0f72e88'} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating volume aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 from snapshot f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] snapshot: f19cf334-25be-4339-90c6-1eb0a0f72e88, volume: aa278193-87a7-4107-8f9d-f2b0a1d8f7b2, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133330c-3277-4c77-a264-ac3bb16ad4e1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Acquiring lock "cinder-7478b1b8-82af-4a40-8f3d-f854620accce-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "cinder-7478b1b8-82af-4a40-8f3d-f854620accce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:47 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:47 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Acquiring lock "cinder-quobyte-7478b1b8-82af-4a40-8f3d-f854620accce" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "cinder-quobyte-7478b1b8-82af-4a40-8f3d-f854620accce" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ce7999-d1f3-4e92-9da6-c93d9ead39dd]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:47 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce Jul 21 08:20:47 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:48 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.509s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5210117-91ac-400a-8b69-7013dbe78d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8c6e4-7fbe-4419-a9c5-94cd457f69af]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:48 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:20:48 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:48 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce" returned: 0 in 0.462s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:48 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce Jul 21 08:20:48 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:48 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:48 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 Jul 21 08:20:48 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:48 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7478b1b8-82af-4a40-8f3d-f854620accce" returned: 0 in 0.391s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "cinder-quobyte-7478b1b8-82af-4a40-8f3d-f854620accce" released by "delete_volume" :: held 0.920s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:48 devstack cinder-volume[87372]: WARNING cinder.quota [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1545623969 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1545623969, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:20:48 devstack cinder-volume[87372]: WARNING cinder.quota [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1545623969 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1545623969, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Created reservations ['cbe2acc2-62b0-4856-b0fb-9af605b71cde', 'b1b15c00-0ef6-4342-9d13-d5f075e5807b', '05bd1798-4b7c-41b6-949b-d94f363794b0', 'c650a228-e23f-471b-a35d-5d004c3caa39'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:48 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:48 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:49 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:49 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Deleted volume successfully. Jul 21 08:20:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3d3d373d-61df-4bbe-a97f-5d92f93b7804 tempest-VolumeTypesAccessTest-418181861 None] Lock "cinder-7478b1b8-82af-4a40-8f3d-f854620accce-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-3ad53d69-b7d4-4379-9541-9e83032ae6ba req-bf164fd1-1455-48f4-aa57-a379ef6b2e4d tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Terminate volume connection completed successfully. Jul 21 08:20:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-3ad53d69-b7d4-4379-9541-9e83032ae6ba req-bf164fd1-1455-48f4-aa57-a379ef6b2e4d tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Deleting attachment 69ad551e-f1c9-45d6-9bd5-57d1f1fadfd6. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "cinder-383eb44f-3242-49c5-87ca-0dd731a4b862-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "cinder-383eb44f-3242-49c5-87ca-0dd731a4b862-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "cinder-quobyte-383eb44f-3242-49c5-87ca-0dd731a4b862" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "cinder-quobyte-383eb44f-3242-49c5-87ca-0dd731a4b862" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[973b1c5f-2d9e-4395-816d-88d3f632c00b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:51 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 Jul 21 08:20:51 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:52 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862" returned: 0 in 0.870s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:52 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862 Jul 21 08:20:52 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:52 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:52 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:52 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-383eb44f-3242-49c5-87ca-0dd731a4b862" returned: 0 in 0.550s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "cinder-quobyte-383eb44f-3242-49c5-87ca-0dd731a4b862" released by "delete_volume" :: held 1.564s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:53 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.393s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Created reservations ['82ed52a5-d439-45ff-bcb8-23e7777e332d', 'eccbf510-df15-4295-85b3-fbf7a8e88149', '1247a724-4526-4611-84e6-127b68c399a5', '47eb1ecc-9497-4df8-b7b7-bcf093bd239c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:53 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:53 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:54 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.914s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Deleted volume successfully. Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e60b139f-8c6a-4ea3-9f50-1b534dddc316 tempest-TestServerVolumeAttachScenarioOldVersion-768402259 None] Lock "cinder-383eb44f-3242-49c5-87ca-0dd731a4b862-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:54 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" returned: 0 in 5.889s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f7136-dd34-49fb-8e86-716c478129ce]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:54 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:20:54 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:55 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.795s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:20:55 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Converted 1024.00 MB image at 173.86 MB/s Jul 21 08:20:55 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 is being set with open permissions: ugo+rw Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:55 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 Jul 21 08:20:55 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:55 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" returned: 0 in 0.316s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" released by "_copy_volume_from_snapshot" :: held 8.151s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" released by "_create_volume_from_snapshot" :: held 8.192s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.214s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534bee8c-759b-4faa-a479-8e821d7c7a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2', 'volume_size': 1, 'snapshot_id': 'f19cf334-25be-4339-90c6-1eb0a0f72e88'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6277e9cb-c022-4278-865e-05c2efffb5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:20:55 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Volume volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 (aa278193-87a7-4107-8f9d-f2b0a1d8f7b2): created successfully Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6277e9cb-c022-4278-865e-05c2efffb5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:20:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Flow 'volume_create_manager' (536697e8-4816-4db6-8216-0c6f8bfac5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:20:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-67107b84-63ee-4ae0-9caf-fad212f78ac7 tempest-VolumesSnapshotTestJSON-1082577965 None] Created volume successfully. Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cea56e-47ec-4d5a-b74c-07bda7ab541b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:56 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 Jul 21 08:20:56 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:57 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:57 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2 Jul 21 08:20:57 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:57 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2" released by "delete_volume" :: held 0.746s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['679ba332-fca6-4dbe-8f0f-009784e2446d', '905340ac-a0dc-4056-93b1-fe5110786ba6', 'e103f3e9-0608-4be2-aed3-f7a428cd4537', 'e1c1ff55-753e-42d9-ae73-595086dd3b67'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:57 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:20:57 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-f19cf334-25be-4339-90c6-1eb0a0f72e88-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-f19cf334-25be-4339-90c6-1eb0a0f72e88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Deleting offline snapshot f19cf334-25be-4339-90c6-1eb0a0f72e88 of volume f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:20:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] snapshot_file for this snap is: volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[911f1d9e-812e-47e4-9252-e625ae54d6a5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:58 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.353s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:20:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Deleted volume successfully. Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e49ee0d7-95e1-4ad2-b0d5-c3f6628e6b93 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-aa278193-87a7-4107-8f9d-f2b0a1d8f7b2-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:58 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:58 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:58 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.450s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5210117-91ac-400a-8b69-7013dbe78d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ea16c-16d2-4c1e-b923-19aa270922a7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:58 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:20:58 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:58 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.425s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:58 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:58 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:59 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.353s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:20:59 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88 Jul 21 08:20:59 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:20:59 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94.f19cf334-25be-4339-90c6-1eb0a0f72e88" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f19cf334-25be-4339-90c6-1eb0a0f72e88" released by "_delete_snapshot" :: held 1.661s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" released by "delete_snapshot" :: held 1.699s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['602f1a43-3cca-41d6-8bd9-f34cb9d8c87e', '447afcf9-e3a2-4657-9200-6104b09d18a4', '6924f5bc-ffe8-4097-a2d5-303e80429d7c', 'd256c68e-b5cc-44ca-9e19-e1f2605c89cd'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:20:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Delete snapshot completed successfully. Jul 21 08:20:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c2bbe93c-778c-4cb3-8bf6-00534e20a09e tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-f19cf334-25be-4339-90c6-1eb0a0f72e88-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-f5210117-91ac-400a-8b69-7013dbe78d94-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-f5210117-91ac-400a-8b69-7013dbe78d94-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45dbcd6-7769-458f-8e04-a5b56553d9bc]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:00 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:21:00 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:00 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.411s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:00 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94 Jul 21 08:21:00 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:01 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f5210117-91ac-400a-8b69-7013dbe78d94" returned: 0 in 0.292s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-f5210117-91ac-400a-8b69-7013dbe78d94" released by "delete_volume" :: held 0.778s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['a079dafd-ee32-4371-bbc4-fb23c4470892', 'bc1854a2-acc4-42b4-a508-cc9bc4e7e960', '6948808f-703f-43f2-94f2-ac0e3f8ed1e2', '065fa65a-0b15-466b-b4c0-8fe59b38a426'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:01 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:01 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-985ae2bf-665c-449c-8bb9-65382017528e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-985ae2bf-665c-449c-8bb9-65382017528e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:01 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.420s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Deleted volume successfully. Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a54bd-353a-4c5a-819b-a462f18ff564]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-695c5dea-2ae3-42b8-939d-6fc5f4567ffe tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-f5210117-91ac-400a-8b69-7013dbe78d94-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:01 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e Jul 21 08:21:01 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:02 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e" returned: 0 in 0.456s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:02 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e Jul 21 08:21:02 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:02 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-985ae2bf-665c-449c-8bb9-65382017528e" returned: 0 in 0.318s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-quobyte-985ae2bf-665c-449c-8bb9-65382017528e" released by "delete_volume" :: held 0.856s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Created reservations ['34fc5c1a-47e1-46c2-aa98-59885735684d', 'dcc3007b-79e1-4d07-b4ba-37724a45b9a4', '9d84481d-3133-4107-9203-25139fae1144', '66699416-8aee-41ee-a025-43ba2d2786c8'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:02 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:02 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:03 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.324s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:03 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:03 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Deleted volume successfully. Jul 21 08:21:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b37a5352-8ae5-4e4e-b524-27dbcbcbe418 tempest-VolumesSnapshotTestJSON-1082577965 None] Lock "cinder-985ae2bf-665c-449c-8bb9-65382017528e-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=130,cinder:UPDATE=155,cinder:INSERT=40,cinder:DELETE=14 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=133,cinder:UPDATE=155,cinder:INSERT=42,cinder:DELETE=13 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Flow 'volume_create_manager' (55651bfd-f0d6-4712-9e29-99f5d6bfc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e24355c-f385-4028-885a-5f9c12b736e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e24355c-f385-4028-885a-5f9c12b736e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2005596880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55bc1f4-60eb-488b-8f5b-2851aae0d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cc3b0a74764381a4650430287cd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:11Z,use_quota=True,user_id='a2422e3293444b57bf372e9e0a7414e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7463ebd-c54d-43f0-bdd6-02137b530e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7463ebd-c54d-43f0-bdd6-02137b530e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b787c0-3f7f-43ff-89b3-49707dfddce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b787c0-3f7f-43ff-89b3-49707dfddce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55bc1f4-60eb-488b-8f5b-2851aae0d29e', 'volume_name': 'volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e', 'volume_size': 2}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b477cd37-9700-4cbc-89fc-87d5341c5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b477cd37-9700-4cbc-89fc-87d5341c5117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c07d9-1275-4707-a92f-03dcb61df9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Volume f55bc1f4-60eb-488b-8f5b-2851aae0d29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e', 'volume_size': 2} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2005596880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55bc1f4-60eb-488b-8f5b-2851aae0d29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cc3b0a74764381a4650430287cd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:11Z,use_quota=True,user_id='a2422e3293444b57bf372e9e0a7414e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Creating volume f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e 2147483648 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:10 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e 2147483648 Jul 21 08:21:10 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:11 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e 2147483648" returned: 0 in 0.710s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:11 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e Jul 21 08:21:11 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:12 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" returned: 0 in 0.338s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7c07d9-1275-4707-a92f-03dcb61df9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e', 'volume_size': 2}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5aead69-c0ce-4712-a90f-7b34b246d7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Volume volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e (f55bc1f4-60eb-488b-8f5b-2851aae0d29e): created successfully Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5aead69-c0ce-4712-a90f-7b34b246d7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Flow 'volume_create_manager' (55651bfd-f0d6-4712-9e29-99f5d6bfc878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a762dea0-dbad-4f2d-8737-712556b72722 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Created volume successfully. Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Creating offline snapshot 5c764c9b-3342-4cdc-907d-a2b55a7a2fec of volume f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:21:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0817c4-3349-4d2e-ab72-07f2996dccdb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:13 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e Jul 21 08:21:13 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:13 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec 2G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:13 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec 2G Jul 21 08:21:13 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:14 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec 2G" returned: 0 in 0.608s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:14 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec Jul 21 08:21:14 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:14 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec" returned: 0 in 0.399s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:14 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec is being set with open permissions: ugo+rw Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:14 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec Jul 21 08:21:14 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:14 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:14 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info Jul 21 08:21:14 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:15 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:15 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info is being set with open permissions: ugo+rw Jul 21 08:21:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:15 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info Jul 21 08:21:15 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:15 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.info" returned: 0 in 0.334s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e2b347bd-05fa-4999-86b0-457efc2148f4 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Create snapshot completed successfully Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "cinder-5c764c9b-3342-4cdc-907d-a2b55a7a2fec-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-5c764c9b-3342-4cdc-907d-a2b55a7a2fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Flow 'volume_create_manager' (6f498b66-c240-4cdb-b051-caa8e326f8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa9c807-864a-4484-8e7c-ec42a7a2c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa9c807-864a-4484-8e7c-ec42a7a2c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0704cc19-a444-434b-a2d6-cd917a5c4b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10fc362417d427fa1d14a5a3198b7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:16Z,use_quota=True,user_id='6f24b5cf830c45409da6ad63de619ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4992d904-8df4-4ca2-bcf2-7a97ee4c8830),volume_type_id=4992d904-8df4-4ca2-bcf2-7a97ee4c8830)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62168c9-bef6-4e6d-a168-50de4eb07cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62168c9-bef6-4e6d-a168-50de4eb07cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5483e6c5-dea6-45c1-a1bc-d90845821a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "cinder-quobyte-5c764c9b-3342-4cdc-907d-a2b55a7a2fec" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-5c764c9b-3342-4cdc-907d-a2b55a7a2fec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Deleting offline snapshot 5c764c9b-3342-4cdc-907d-a2b55a7a2fec of volume f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] snapshot_file for this snap is: volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5e244-dd14-4ffa-987e-5b292bc93bd5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:16 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec Jul 21 08:21:16 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5483e6c5-dea6-45c1-a1bc-d90845821a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0704cc19-a444-434b-a2d6-cd917a5c4b9f', 'volume_name': 'volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f', 'volume_size': 1, 'image_id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5cae6dc766ecdd7d19714cfad221004e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c10fc362417d427fa1d14a5a3198b7f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c28351e8bf376bce24b19043d3da8aad15976b94b25230cebc32cb0e65291869db60d64452e6b8cf2a66e46402fffff5c5cabd6bdf4961e175c8068c3ac2f9a', 'id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'created_at': datetime.datetime(2026, 7, 21, 6, 21, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 21, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10051294-3243-41db-8537-79b01af3f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10051294-3243-41db-8537-79b01af3f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d15f58-455e-4c6d-b74f-fed8499a7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f', 'volume_size': 1, 'image_id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5cae6dc766ecdd7d19714cfad221004e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c10fc362417d427fa1d14a5a3198b7f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c28351e8bf376bce24b19043d3da8aad15976b94b25230cebc32cb0e65291869db60d64452e6b8cf2a66e46402fffff5c5cabd6bdf4961e175c8068c3ac2f9a', 'id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'created_at': datetime.datetime(2026, 7, 21, 6, 21, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 21, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Trying to clone 0704cc19-a444-434b-a2d6-cd917a5c4b9f from image 4aa782f7-0653-48d2-868b-33caa9f7bb7e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:21:16 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Image download 0.00 MB at 0.00 MB/s Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eeb7c3-b56b-4d55-b74a-5f82b153d9df]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:16 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd753c90-7d23-43da-bccc-aad5587230b6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:16 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:16 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:17 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e Jul 21 08:21:17 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:17 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:17 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:17 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:17 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" returned: 0 in 0.441s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:17 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec Jul 21 08:21:17 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:17 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Temporary image 4aa782f7-0653-48d2-868b-33caa9f7bb7e is fetched for user 6f24b5cf830c45409da6ad63de619ac5. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f11d0-f225-4e67-bc25-a319f7d1660f]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:17 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec" returned: 0 in 0.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:17 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:17 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:17 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec Jul 21 08:21:17 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:18 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:18 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e.5c764c9b-3342-4cdc-907d-a2b55a7a2fec" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-5c764c9b-3342-4cdc-907d-a2b55a7a2fec" released by "_delete_snapshot" :: held 1.660s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" released by "delete_snapshot" :: held 1.685s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:18 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:18 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Created reservations ['18053cf2-d4f3-4e69-bd36-9c1c8942c276', '1dde5127-8839-47b0-9800-fd7107eebcaa', '1452fc1f-63d7-4c5b-8015-536e38269720', '7afc1233-2922-4e82-9734-28aa5399f2fb'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Delete snapshot completed successfully. Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a61e6d5e-8aba-4cf1-9566-9a2bfc29516c tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-5c764c9b-3342-4cdc-907d-a2b55a7a2fec-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:18 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0704cc19-a444-434b-a2d6-cd917a5c4b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c10fc362417d427fa1d14a5a3198b7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:16Z,use_quota=True,user_id='6f24b5cf830c45409da6ad63de619ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4992d904-8df4-4ca2-bcf2-7a97ee4c8830),volume_type_id=4992d904-8df4-4ca2-bcf2-7a97ee4c8830)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Creating volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:18 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1073741824 Jul 21 08:21:18 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "cinder-f55bc1f4-60eb-488b-8f5b-2851aae0d29e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-f55bc1f4-60eb-488b-8f5b-2851aae0d29e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a87242-a9e8-4677-bbab-7316bfb6e35d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:18 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e Jul 21 08:21:18 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:18 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1073741824" returned: 0 in 0.474s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:18 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f Jul 21 08:21:18 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:19 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:19 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e Jul 21 08:21:19 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:19 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Attempting download of 4aa782f7-0653-48d2-868b-33caa9f7bb7e ((None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}])) to volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[461fdac7-d736-473d-8602-dd5aa5371f11]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:19 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:19 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7 Jul 21 08:21:19 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-quobyte-f55bc1f4-60eb-488b-8f5b-2851aae0d29e" released by "delete_volume" :: held 0.759s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Created reservations ['c36c7b62-d1e7-4c98-8d23-823c1ca0d2b1', '7a47500c-96bf-458b-a8bb-009304bff07d', 'ca3bcc2f-97b8-4f4c-b7ba-3aa6ae966d36', '58ef83a7-467b-449f-8320-cbaa9c8e89eb'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:19 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:19 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:19 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7" returned: 0 in 0.387s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:19 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7 Jul 21 08:21:19 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:19 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.274s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Deleted volume successfully. Jul 21 08:21:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8a327331-6ded-4056-b793-16ac752983f3 tempest-VolumesSnapshotNegativeTestJSON-86036734 None] Lock "cinder-f55bc1f4-60eb-488b-8f5b-2851aae0d29e-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:20 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7" returned: 1 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4aa782f7-0653-48d2-868b-33caa9f7bb7e_4s31lhl7' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa3de0-0177-42cb-ae07-eb3a44890c76]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:20 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:20 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:20 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:20 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD Jul 21 08:21:20 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:20 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] 4aa782f7-0653-48d2-868b-33caa9f7bb7e was raw, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:21:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:20 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f Jul 21 08:21:20 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:21 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f" returned: 0 in 0.553s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4aa782f7-0653-48d2-868b-33caa9f7bb7e_6b3y8gtzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:21:21 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:21 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1G Jul 21 08:21:21 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:21 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f 1G" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Downloaded image 4aa782f7-0653-48d2-868b-33caa9f7bb7e ((None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}])) to volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Temporary image 4aa782f7-0653-48d2-868b-33caa9f7bb7e for user 6f24b5cf830c45409da6ad63de619ac5 is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Marking volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Copying metadata from image 4aa782f7-0653-48d2-868b-33caa9f7bb7e to 0704cc19-a444-434b-a2d6-cd917a5c4b9f. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Creating volume glance metadata for volume 0704cc19-a444-434b-a2d6-cd917a5c4b9f backed by image 4aa782f7-0653-48d2-868b-33caa9f7bb7e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5cae6dc766ecdd7d19714cfad221004e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d15f58-455e-4c6d-b74f-fed8499a7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f', 'volume_size': 1, 'image_id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5cae6dc766ecdd7d19714cfad221004e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c10fc362417d427fa1d14a5a3198b7f4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c28351e8bf376bce24b19043d3da8aad15976b94b25230cebc32cb0e65291869db60d64452e6b8cf2a66e46402fffff5c5cabd6bdf4961e175c8068c3ac2f9a', 'id': '4aa782f7-0653-48d2-868b-33caa9f7bb7e', 'created_at': datetime.datetime(2026, 7, 21, 6, 21, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 21, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4aa782f7-0653-48d2-868b-33caa9f7bb7e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9e5aff-3e8d-41ec-bbbe-042ad77f48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Volume volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f (0704cc19-a444-434b-a2d6-cd917a5c4b9f): created successfully Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9e5aff-3e8d-41ec-bbbe-042ad77f48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Flow 'volume_create_manager' (6f498b66-c240-4cdb-b051-caa8e326f8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-82716f88-d0cc-4883-858b-c4a43b013558 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Created volume successfully. Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Acquiring lock "cinder-0704cc19-a444-434b-a2d6-cd917a5c4b9f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "cinder-0704cc19-a444-434b-a2d6-cd917a5c4b9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Acquiring lock "cinder-quobyte-0704cc19-a444-434b-a2d6-cd917a5c4b9f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "cinder-quobyte-0704cc19-a444-434b-a2d6-cd917a5c4b9f" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd922add-a53c-4ffb-9599-9535ef89ee95]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:22 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f Jul 21 08:21:22 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:23 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f" returned: 0 in 0.424s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:23 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f Jul 21 08:21:23 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:23 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0704cc19-a444-434b-a2d6-cd917a5c4b9f" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "cinder-quobyte-0704cc19-a444-434b-a2d6-cd917a5c4b9f" released by "delete_volume" :: held 0.782s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:23 devstack cinder-volume[87372]: WARNING cinder.quota [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:21:23 devstack cinder-volume[87372]: WARNING cinder.quota [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Created reservations ['6d8a91a8-9699-4e75-a9bc-c8d14d28e466', '8f1d7b9f-670b-47f1-a1b1-98b506ecf229', 'b03acf67-a7f2-47f4-8c0f-1f821678cfbb', 'a8061c06-6c12-4d02-935c-e9f8f03dcf55'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:23 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:23 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:24 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.347s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:24 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Deleted volume successfully. Jul 21 08:21:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7117e73d-12bf-4b61-bbaf-27b781c7cb84 tempest-VolumeAndVolumeTypeFromImageTest-490815846 None] Lock "cinder-0704cc19-a444-434b-a2d6-cd917a5c4b9f-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:31 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Flow 'volume_create_manager' (0219479b-720d-4c73-9648-4244946ad52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e690df41-acc9-44c8-a670-1e2244fc5258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e690df41-acc9-44c8-a670-1e2244fc5258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144401459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10357cbf-c43d-472c-943f-8c557ddeb843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cfbf3f106f4ae991fc596027caf464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:32Z,use_quota=True,user_id='7f83dd35d83040b69782b43adb92f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9963e1eb-0a75-472d-ac53-a38fd9f360d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9963e1eb-0a75-472d-ac53-a38fd9f360d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6375a22-ca68-4d33-9ccd-b0f129fa74db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6375a22-ca68-4d33-9ccd-b0f129fa74db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10357cbf-c43d-472c-943f-8c557ddeb843', 'volume_name': 'volume-10357cbf-c43d-472c-943f-8c557ddeb843', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8f769b-88cc-4b54-b5ad-dd75dda7f149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8f769b-88cc-4b54-b5ad-dd75dda7f149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f4ffad-82f8-46e6-9942-db1bbc60c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:32 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Volume 10357cbf-c43d-472c-943f-8c557ddeb843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10357cbf-c43d-472c-943f-8c557ddeb843', 'volume_size': 1} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144401459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10357cbf-c43d-472c-943f-8c557ddeb843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cfbf3f106f4ae991fc596027caf464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:32Z,use_quota=True,user_id='7f83dd35d83040b69782b43adb92f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Creating volume 10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:32 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:32 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 1073741824 Jul 21 08:21:32 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:32 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 1073741824" returned: 0 in 0.720s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:32 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:32 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:33 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f4ffad-82f8-46e6-9942-db1bbc60c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10357cbf-c43d-472c-943f-8c557ddeb843', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c98368c-f846-498c-9a1d-0433b661e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:33 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Volume volume-10357cbf-c43d-472c-943f-8c557ddeb843 (10357cbf-c43d-472c-943f-8c557ddeb843): created successfully Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c98368c-f846-498c-9a1d-0433b661e268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Flow 'volume_create_manager' (0219479b-720d-4c73-9648-4244946ad52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-95e105de-0236-4b70-bc66-0c28c2c28624 tempest-VolumeDependencyTests-1756872901 None] Created volume successfully. Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Creating offline snapshot c3d76f71-ecf8-4208-857e-51057cea9603 of volume 10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7fe768-8b3f-4159-b7a2-f8354a51f367]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:34 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:34 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:34 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.590s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:34 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 1G Jul 21 08:21:34 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:35 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 1G" returned: 0 in 0.529s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10357cbf-c43d-472c-943f-8c557ddeb843 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:35 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10357cbf-c43d-472c-943f-8c557ddeb843 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:35 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:35 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10357cbf-c43d-472c-943f-8c557ddeb843 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:35 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 is being set with open permissions: ugo+rw Jul 21 08:21:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:35 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:35 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:36 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:36 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info Jul 21 08:21:36 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:36 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:36 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info is being set with open permissions: ugo+rw Jul 21 08:21:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:36 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info Jul 21 08:21:36 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:37 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.info" returned: 0 in 0.330s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-efee924b-1688-4d7e-ba56-d8087bdc7387 tempest-VolumeDependencyTests-1756872901 None] Create snapshot completed successfully Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Flow 'volume_create_manager' (e237db0b-3d44-47d0-90aa-b75baa40a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf7854-57b7-4ec5-adf6-e9025651f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf7854-57b7-4ec5-adf6-e9025651f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-341316995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8def8fe5-ccc5-4435-b71d-9182ff536bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cfbf3f106f4ae991fc596027caf464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3d76f71-ecf8-4208-857e-51057cea9603,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:38Z,use_quota=True,user_id='7f83dd35d83040b69782b43adb92f801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c98f0b9-2191-43e0-9816-e57f922a1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c98f0b9-2191-43e0-9816-e57f922a1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b00046-8246-485f-aa85-3ab042e29b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b00046-8246-485f-aa85-3ab042e29b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8def8fe5-ccc5-4435-b71d-9182ff536bf2', 'volume_name': 'volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2', 'volume_size': 1, 'snapshot_id': 'c3d76f71-ecf8-4208-857e-51057cea9603'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d6b2ba-5dd3-4ee6-8fbc-121d79c9c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d6b2ba-5dd3-4ee6-8fbc-121d79c9c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d611d5c1-edd9-469e-bc7c-6875c997feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Volume 8def8fe5-ccc5-4435-b71d-9182ff536bf2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2', 'volume_size': 1, 'snapshot_id': 'c3d76f71-ecf8-4208-857e-51057cea9603'} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603-8def8fe5-ccc5-4435-b71d-9182ff536bf2" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603-8def8fe5-ccc5-4435-b71d-9182ff536bf2" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Creating volume 8def8fe5-ccc5-4435-b71d-9182ff536bf2 from snapshot c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] snapshot: c3d76f71-ecf8-4208-857e-51057cea9603, volume: 8def8fe5-ccc5-4435-b71d-9182ff536bf2, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7f3e32-5bbf-44e0-84be-b78fa5d4d91f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:38 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:38 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:39 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10357cbf-c43d-472c-943f-8c557ddeb843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[68470d54-87af-4c7b-bb2a-e955f7b0c21c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:39 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:39 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:39 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.610s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:21:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:39 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 Jul 21 08:21:39 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (ddec7f95-b6d4-4173-bec9-0e94eb492ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cb8bca-6f08-465a-8b26-2ea32ad7f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cb8bca-6f08-465a-8b26-2ea32ad7f6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026946544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00882ecc-02a9-406c-a603-bf49480c6a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:40Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e3397-ba1b-40ba-8052-911b3162e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e3397-ba1b-40ba-8052-911b3162e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375afc1d-74f0-4622-bb4e-704667143957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375afc1d-74f0-4622-bb4e-704667143957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00882ecc-02a9-406c-a603-bf49480c6a96', 'volume_name': 'volume-00882ecc-02a9-406c-a603-bf49480c6a96', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f911a58c-65ca-4784-9dc8-74b13ca7e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f911a58c-65ca-4784-9dc8-74b13ca7e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b549a469-3c03-4e95-99c7-d4c8bf4149c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Volume 00882ecc-02a9-406c-a603-bf49480c6a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00882ecc-02a9-406c-a603-bf49480c6a96', 'volume_size': 1} Jul 21 08:21:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:46 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2" returned: 0 in 6.584s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480f5d8-c8d5-41ff-bee3-0b42679572e1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:46 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:46 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:46 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.614s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:21:47 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Converted 1024.00 MB image at 155.47 MB/s Jul 21 08:21:47 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 is being set with open permissions: ugo+rw Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:47 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 Jul 21 08:21:47 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:47 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" released by "_copy_volume_from_snapshot" :: held 8.604s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603-8def8fe5-ccc5-4435-b71d-9182ff536bf2" released by "_create_volume_from_snapshot" :: held 8.650s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.676s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.821s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026946544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00882ecc-02a9-406c-a603-bf49480c6a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:40Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Creating volume 00882ecc-02a9-406c-a603-bf49480c6a96 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:47 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:47 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 1073741824 Jul 21 08:21:47 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d611d5c1-edd9-469e-bc7c-6875c997feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2', 'volume_size': 1, 'snapshot_id': 'c3d76f71-ecf8-4208-857e-51057cea9603'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b345323-1c9a-4705-bc0e-cec521b75241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:47 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Volume volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 (8def8fe5-ccc5-4435-b71d-9182ff536bf2): created successfully Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b345323-1c9a-4705-bc0e-cec521b75241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Flow 'volume_create_manager' (e237db0b-3d44-47d0-90aa-b75baa40a196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-416e648e-8375-4491-ac24-96c092ce1abe tempest-VolumeDependencyTests-1756872901 None] Created volume successfully. Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-c3d76f71-ecf8-4208-857e-51057cea9603-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-c3d76f71-ecf8-4208-857e-51057cea9603-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Deleting offline snapshot c3d76f71-ecf8-4208-857e-51057cea9603 of volume 10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] snapshot_file for this snap is: volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48066a9-34bf-445c-80db-d65fad41724d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:48 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 1073741824" returned: 0 in 0.797s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:48 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:48 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:48 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 Jul 21 08:21:48 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:48 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b549a469-3c03-4e95-99c7-d4c8bf4149c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00882ecc-02a9-406c-a603-bf49480c6a96', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd1e8dc-3d13-45c3-a45c-20d92901f361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:48 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.672s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10357cbf-c43d-472c-943f-8c557ddeb843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:21:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Volume volume-00882ecc-02a9-406c-a603-bf49480c6a96 (00882ecc-02a9-406c-a603-bf49480c6a96): created successfully Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd1e8dc-3d13-45c3-a45c-20d92901f361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (ddec7f95-b6d4-4173-bec9-0e94eb492ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[229af570-0b3d-4d2f-92b8-1a36e245a982]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e615bb44-c28c-4207-9f1e-c688d71ebf90 tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:21:48 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:48 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:49 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.424s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:49 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:49 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-01070092-6b6b-48ea-9612-4d6645394c67 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96" by "attach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-01070092-6b6b-48ea-9612-4d6645394c67 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96" acquired by "attach_volume" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01070092-6b6b-48ea-9612-4d6645394c67 tempest-VolumesActionsTest-2136394100 None] Attaching volume 00882ecc-02a9-406c-a603-bf49480c6a96 to instance d4735a6e-828c-4be1-b145-60142c5b24b0 at mountpoint /dev/vdb on host None. Jul 21 08:21:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-01070092-6b6b-48ea-9612-4d6645394c67 tempest-VolumesActionsTest-2136394100 None] Attach volume completed successfully. Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-01070092-6b6b-48ea-9612-4d6645394c67 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96" released by "attach_volume" :: held 0.100s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:49 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.536s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:49 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603 Jul 21 08:21:49 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:49 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843.c3d76f71-ecf8-4208-857e-51057cea9603" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-c3d76f71-ecf8-4208-857e-51057cea9603" released by "_delete_snapshot" :: held 2.209s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" released by "delete_snapshot" :: held 2.246s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Created reservations ['3f2e4765-f12f-4e2b-a6c1-80cf1e67a17b', '2de781bf-f298-47d0-bcd7-6822673e19f5', 'd1328100-bd1f-404b-91d2-975ace1f1959', 'd553bd25-fa5b-4eda-8e11-61cf0f8259ff'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Delete snapshot completed successfully. Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1c153e25-62e6-4dd1-9184-c3818eada12a tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-c3d76f71-ecf8-4208-857e-51057cea9603-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Terminate volume connection completed successfully. Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" by "detach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Detaching volume 00882ecc-02a9-406c-a603-bf49480c6a96 from instance d4735a6e-828c-4be1-b145-60142c5b24b0. Jul 21 08:21:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Detach volume completed successfully. Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0e3aea4e-d922-482a-9a8b-56622911ace0 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a37716d-be95-4ff3-b656-e7609da705fb tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" by "detach_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a37716d-be95-4ff3-b656-e7609da705fb tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2a37716d-be95-4ff3-b656-e7609da705fb tempest-VolumesActionsTest-2136394100 None] Volume detach called, but volume not attached. Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a37716d-be95-4ff3-b656-e7609da705fb tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-10357cbf-c43d-472c-943f-8c557ddeb843-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-quobyte-00882ecc-02a9-406c-a603-bf49480c6a96" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-10357cbf-c43d-472c-943f-8c557ddeb843-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-quobyte-00882ecc-02a9-406c-a603-bf49480c6a96" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eba990-8100-445c-bbab-b445e86c8f96]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec14c6-e4d1-4ac7-b100-da79a3baf1d2]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:51 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 Jul 21 08:21:51 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:51 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:51 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:51 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96" returned: 0 in 0.579s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:51 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96 Jul 21 08:21:51 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:51 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.592s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:51 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843 Jul 21 08:21:51 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:52 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-00882ecc-02a9-406c-a603-bf49480c6a96" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-quobyte-00882ecc-02a9-406c-a603-bf49480c6a96" released by "delete_volume" :: held 0.933s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Created reservations ['444f42af-ebca-4f9f-b918-e5894c6ceb30', '5122907e-7915-4f7d-98d2-c477fa395058', '91345d6b-0c7f-4f7e-a761-4d4be1db6181', '72b0f717-8039-4b69-84d8-c810b3281468'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:52 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10357cbf-c43d-472c-943f-8c557ddeb843" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-10357cbf-c43d-472c-943f-8c557ddeb843" released by "delete_volume" :: held 1.021s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:52 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:52 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Created reservations ['1505c692-c080-41c8-b177-e27bdd00d1b2', 'e2c8de6d-7812-4318-baa8-da102615690f', '5d5aeddb-0544-421f-a959-d2a85b68173a', 'da7a6a38-de41-4164-b394-4831f3670814'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:52 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:52 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:52 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Deleted volume successfully. Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-21c89f65-40d4-4f7c-b173-76e4870c42a4 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-00882ecc-02a9-406c-a603-bf49480c6a96-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:52 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:52 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:52 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.283s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Deleted volume successfully. Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a52905b5-b17c-4fd2-9334-f200d78217b0 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-10357cbf-c43d-472c-943f-8c557ddeb843-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:52 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.242s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:21:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-8def8fe5-ccc5-4435-b71d-9182ff536bf2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-8def8fe5-ccc5-4435-b71d-9182ff536bf2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ce1e3-f8e9-4fa8-a69c-e577fcbcd5c1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:53 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 Jul 21 08:21:53 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:54 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2" returned: 0 in 0.644s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:54 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2 Jul 21 08:21:54 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:54 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8def8fe5-ccc5-4435-b71d-9182ff536bf2" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-quobyte-8def8fe5-ccc5-4435-b71d-9182ff536bf2" released by "delete_volume" :: held 1.152s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Created reservations ['aa144907-2bde-4168-9528-17b80c19f6b2', 'c8b2dd46-eb66-467f-abde-aa5166d8ce7d', 'c877bee0-14b7-4fd0-9597-1c341b430e21', '388feaa0-6196-4543-8010-2dc4409fca73'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:54 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:21:54 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:55 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.313s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:55 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:21:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Deleted volume successfully. Jul 21 08:21:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ad442494-763b-4ead-84e0-cf67f024f8d5 tempest-VolumeDependencyTests-1756872901 None] Lock "cinder-8def8fe5-ccc5-4435-b71d-9182ff536bf2-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Flow 'volume_create_manager' (95deccc5-9d8e-42eb-95f0-b9cc8c16d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87404aa0-33e3-4b8b-a0f9-ca84965c65be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87404aa0-33e3-4b8b-a0f9-ca84965c65be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1172332088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10956e34-00b6-46d8-b133-36c2155338d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e8a31148ea4a6fa30b6cc8b030223d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:56Z,use_quota=True,user_id='de8ae0738abc4dba91378bf774432c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21498017-19bd-4ef9-a19c-baecf9b585e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21498017-19bd-4ef9-a19c-baecf9b585e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87463e97-4489-40fa-9566-c1f27a749ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (bac754c0-5b38-4f25-8dc8-6b118d2adc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05859de2-5349-457b-8555-0734cf8996c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05859de2-5349-457b-8555-0734cf8996c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2043277924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa127061-7110-4025-a2ae-440b51fa5e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:57Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060afcbb-2de4-4375-b448-32e3510e0392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060afcbb-2de4-4375-b448-32e3510e0392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b319d64d-2592-4b84-8942-7e327ee05406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b319d64d-2592-4b84-8942-7e327ee05406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa127061-7110-4025-a2ae-440b51fa5e05', 'volume_name': 'volume-fa127061-7110-4025-a2ae-440b51fa5e05', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59da3a-bdaf-4ad1-851e-6cc621cab807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59da3a-bdaf-4ad1-851e-6cc621cab807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bb59cf-91e0-48dd-b383-d37ed6f1930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Volume fa127061-7110-4025-a2ae-440b51fa5e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa127061-7110-4025-a2ae-440b51fa5e05', 'volume_size': 1} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2043277924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa127061-7110-4025-a2ae-440b51fa5e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:57Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Creating volume fa127061-7110-4025-a2ae-440b51fa5e05 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:56 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:56 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 1073741824 Jul 21 08:21:56 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87463e97-4489-40fa-9566-c1f27a749ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10956e34-00b6-46d8-b133-36c2155338d3', 'volume_name': 'volume-10956e34-00b6-46d8-b133-36c2155338d3', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7fb4f-02c3-479c-bea0-acc407564b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7fb4f-02c3-479c-bea0-acc407564b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b73287-c20a-435f-962e-dd0d6dcf0908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:57 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Volume 10956e34-00b6-46d8-b133-36c2155338d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10956e34-00b6-46d8-b133-36c2155338d3', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Trying to clone 10956e34-00b6-46d8-b133-36c2155338d3 from image a3f8b652-69e7-49da-931e-22bcdb879c31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:21:57 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Image download 20.69 MB at 20.69 MB/s Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff9a93-74c6-4d90-be37-0896830bb55b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:57 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 1073741824" returned: 0 in 0.593s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:57 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 Jul 21 08:21:57 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:57 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD Jul 21 08:21:57 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:57 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22bb59cf-91e0-48dd-b383-d37ed6f1930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa127061-7110-4025-a2ae-440b51fa5e05', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea7b2be-ece6-49c4-a4ab-50489c014b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:57 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Volume volume-fa127061-7110-4025-a2ae-440b51fa5e05 (fa127061-7110-4025-a2ae-440b51fa5e05): created successfully Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea7b2be-ece6-49c4-a4ab-50489c014b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (bac754c0-5b38-4f25-8dc8-6b118d2adc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:57 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 is fetched for user de8ae0738abc4dba91378bf774432c9a. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:21:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5ef1c93f-5f1b-49f0-b7fe-95c01bf4a530 tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ddcc5-46d3-4f37-8198-bc52e521d361]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:58 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD Jul 21 08:21:58 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:58 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1172332088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10956e34-00b6-46d8-b133-36c2155338d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e8a31148ea4a6fa30b6cc8b030223d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:56Z,use_quota=True,user_id='de8ae0738abc4dba91378bf774432c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Creating volume 10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:58 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:58 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1073741824 Jul 21 08:21:58 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:58 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1073741824" returned: 0 in 0.464s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:58 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 Jul 21 08:21:58 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Flow 'volume_create_manager' (93ed44df-7721-44d4-904b-a61beedaf5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4192e8c-3ac7-4eea-90f2-a03fbacdcf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4192e8c-3ac7-4eea-90f2-a03fbacdcf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d60c11-ea8d-4d6e-9ec0-124526e1e32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa90af47f9747fd84adcb350167c88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:59Z,use_quota=True,user_id='20bc66ae9633497fa2f03a79c6891233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e0b105-5b10-4e25-8106-0f3cc9443668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e0b105-5b10-4e25-8106-0f3cc9443668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105d56ef-9e77-41d4-ad84-f830be33ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105d56ef-9e77-41d4-ad84-f830be33ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d60c11-ea8d-4d6e-9ec0-124526e1e32f', 'volume_name': 'volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d985101-2123-4f0b-82bb-72b4e8a8fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d985101-2123-4f0b-82bb-72b4e8a8fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a4ec8-349f-4ac7-ae25-32d0cdaa828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:58 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Volume c7d60c11-ea8d-4d6e-9ec0-124526e1e32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f', 'volume_size': 1} Jul 21 08:21:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-fa127061-7110-4025-a2ae-440b51fa5e05-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "cinder-fa127061-7110-4025-a2ae-440b51fa5e05-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-quobyte-fa127061-7110-4025-a2ae-440b51fa5e05" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:21:59 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-fa127061-7110-4025-a2ae-440b51fa5e05" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3" returned: 0 in 0.290s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d60c11-ea8d-4d6e-9ec0-124526e1e32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa90af47f9747fd84adcb350167c88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:21:59Z,use_quota=True,user_id='20bc66ae9633497fa2f03a79c6891233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Creating volume c7d60c11-ea8d-4d6e-9ec0-124526e1e32f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:21:59 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa73b0c-f8fc-4b01-b193-55075a04d560]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f 1073741824 Jul 21 08:21:59 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Attempting download of a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume 10956e34-00b6-46d8-b133-36c2155338d3. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3270a3a0-c670-4b64-b57b-ce6aa2727d1d]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 Jul 21 08:21:59 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo Jul 21 08:21:59 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo" returned: 0 in 0.358s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05 Jul 21 08:21:59 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f 1073741824" returned: 0 in 0.469s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f Jul 21 08:21:59 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo Jul 21 08:21:59 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:21:59 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fa127061-7110-4025-a2ae-440b51fa5e05" returned: 0 in 0.277s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-fa127061-7110-4025-a2ae-440b51fa5e05" released by "delete_volume" :: held 0.754s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:21:59 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Created reservations ['35b0d688-a5de-4839-b3b5-01c7468c351a', '441d1d50-a582-4a23-bc13-f57512d3cce9', '2dc2b2f5-2132-4e30-b8fa-3385ba779d05', '4087c7f7-4974-45f4-88dd-4f72df417eb2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911a4ec8-349f-4ac7-ae25-32d0cdaa828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:59 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1842cb85-c01d-41c3-b445-35e5a7e95fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo" returned: 1 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_23rkpxbo' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ce7428-4bbd-4223-b458-266abb5e4148]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:21:59 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Volume volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f (c7d60c11-ea8d-4d6e-9ec0-124526e1e32f): created successfully Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1842cb85-c01d-41c3-b445-35e5a7e95fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:21:59 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Flow 'volume_create_manager' (93ed44df-7721-44d4-904b-a61beedaf5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:21:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e26737a7-0f99-4031-aa66-4b9fc14a71b1 tempest-CinderUnicodeTest-693818582 None] Created volume successfully. Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:00 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:00 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:00 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD Jul 21 08:22:00 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:00 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.270s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:00 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Deleted volume successfully. Jul 21 08:22:00 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] a3f8b652-69e7-49da-931e-22bcdb879c31 was qcow2, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8e98b4d6-130b-46da-b6cd-ad887c7de9ca tempest-VolumesActionsTest-1931663130 None] Lock "cinder-fa127061-7110-4025-a2ae-440b51fa5e05-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:00 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 Jul 21 08:22:00 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (9c64c2cd-b745-4aed-bbb9-f5c457cfaa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e3a077-5e84-4cd7-b507-c22dc08f2e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e3a077-5e84-4cd7-b507-c22dc08f2e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541082504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07641d6b-1d98-4d41-b57a-0204ad1d7d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:01Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a65bab-0470-4318-a22c-b776354c94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a65bab-0470-4318-a22c-b776354c94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3554093f-6a82-4438-a462-99b4c1d29918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3554093f-6a82-4438-a462-99b4c1d29918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07641d6b-1d98-4d41-b57a-0204ad1d7d6c', 'volume_name': 'volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b5ad50-96d5-451f-ba32-0f20300057bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b5ad50-96d5-451f-ba32-0f20300057bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fad58c-4b96-4032-ba0b-4e5011c67f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:00 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Volume 07641d6b-1d98-4d41-b57a-0204ad1d7d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c', 'volume_size': 1} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1541082504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07641d6b-1d98-4d41-b57a-0204ad1d7d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:01Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Creating volume 07641d6b-1d98-4d41-b57a-0204ad1d7d6c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:00 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:00 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c 1073741824 Jul 21 08:22:00 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:01 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c 1073741824" returned: 0 in 0.537s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:01 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c Jul 21 08:22:01 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Flow 'volume_create_manager' (ae04e6f8-9a41-4fa8-b2fb-85f5f651c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba2fe9c-a18f-4868-a035-807a318ce18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba2fe9c-a18f-4868-a035-807a318ce18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-537867523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8089d243-9205-4194-a003-7442d60233b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa90af47f9747fd84adcb350167c88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:01Z,use_quota=True,user_id='20bc66ae9633497fa2f03a79c6891233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaea68b-1f3c-4fbd-9350-609ee683b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaea68b-1f3c-4fbd-9350-609ee683b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8521a976-82b5-4ca6-a947-b41ffbe548f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8521a976-82b5-4ca6-a947-b41ffbe548f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8089d243-9205-4194-a003-7442d60233b9', 'volume_name': 'volume-8089d243-9205-4194-a003-7442d60233b9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124cb5a3-c479-4911-8662-027931652537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124cb5a3-c479-4911-8662-027931652537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b98cce-b7e5-400d-a713-92a33d67a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Volume 8089d243-9205-4194-a003-7442d60233b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8089d243-9205-4194-a003-7442d60233b9', 'volume_size': 1} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:01 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" returned: 0 in 0.291s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-537867523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8089d243-9205-4194-a003-7442d60233b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa90af47f9747fd84adcb350167c88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:01Z,use_quota=True,user_id='20bc66ae9633497fa2f03a79c6891233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Creating volume 8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:01 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:01 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 1073741824 Jul 21 08:22:01 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fad58c-4b96-4032-ba0b-4e5011c67f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a8419b-14c7-4564-a8ca-ba7958e0d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:01 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Volume volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c (07641d6b-1d98-4d41-b57a-0204ad1d7d6c): created successfully Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a8419b-14c7-4564-a8ca-ba7958e0d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (9c64c2cd-b745-4aed-bbb9-f5c457cfaa86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-506bbd98-ac2a-4a6a-a1f1-c39ab90f428c tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:22:02 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 1073741824" returned: 0 in 0.480s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:02 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3" returned: 0 in 1.885s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_7xv2zbb0devstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:22:02 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Converted 112.00 MB image at 59.38 MB/s Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:02 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1G Jul 21 08:22:02 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:02 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 Jul 21 08:22:02 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:02 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:02 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b98cce-b7e5-400d-a713-92a33d67a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8089d243-9205-4194-a003-7442d60233b9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229e40c-97d8-44ba-a70f-dd0e632ca745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 1G" returned: 0 in 0.359s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Downloaded image a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume 10956e34-00b6-46d8-b133-36c2155338d3 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 for user de8ae0738abc4dba91378bf774432c9a is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Marking volume 10956e34-00b6-46d8-b133-36c2155338d3 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:22:02 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Volume volume-8089d243-9205-4194-a003-7442d60233b9 (8089d243-9205-4194-a003-7442d60233b9): created successfully Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229e40c-97d8-44ba-a70f-dd0e632ca745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Flow 'volume_create_manager' (ae04e6f8-9a41-4fa8-b2fb-85f5f651c83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Copying metadata from image a3f8b652-69e7-49da-931e-22bcdb879c31 to 10956e34-00b6-46d8-b133-36c2155338d3. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Creating volume glance metadata for volume 10956e34-00b6-46d8-b133-36c2155338d3 backed by image a3f8b652-69e7-49da-931e-22bcdb879c31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:22:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-42fda066-0127-4dfa-a532-db071ee8e364 tempest-CinderUnicodeTest-693818582 None] Created volume successfully. Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b73287-c20a-435f-962e-dd0d6dcf0908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10956e34-00b6-46d8-b133-36c2155338d3', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd46cb-da4c-4198-ac0d-e6e0ee5f92ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:02 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Volume volume-10956e34-00b6-46d8-b133-36c2155338d3 (10956e34-00b6-46d8-b133-36c2155338d3): created successfully Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd46cb-da4c-4198-ac0d-e6e0ee5f92ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Flow 'volume_create_manager' (95deccc5-9d8e-42eb-95f0-b9cc8c16d883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-236c3c15-09bb-4f09-92ae-c76eb563dbb1 tempest-TestShelveInstance-1478294953 None] Created volume successfully. Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-07641d6b-1d98-4d41-b57a-0204ad1d7d6c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "cinder-07641d6b-1d98-4d41-b57a-0204ad1d7d6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-quobyte-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16a4e5-df8e-41ba-83b6-879e32e5eb3d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:03 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c Jul 21 08:22:03 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:03 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" returned: 0 in 0.354s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:03 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c Jul 21 08:22:03 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:03 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" returned: 0 in 0.278s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-07641d6b-1d98-4d41-b57a-0204ad1d7d6c" released by "delete_volume" :: held 0.677s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Created reservations ['b7aa3dcf-dd6a-467c-8d77-f6b29611810d', '24dc2627-6d33-4c50-b4a9-a5fa65202a59', 'c0e64131-bc71-4cd2-ae11-0c49d2fcc359', '39aa5118-b82f-4275-865f-fefdda94af6e'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:03 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:03 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Creating offline snapshot 19d31019-69d5-4731-b7b9-2c70ab91487e of volume 8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc72083-9f4b-43c7-a15d-2ae39e95ebd4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:04 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 Jul 21 08:22:04 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:04 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:04 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Deleted volume successfully. Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-099fa3f9-ce91-44cf-a1ef-8d4c51231bcf tempest-VolumesActionsTest-1931663130 None] Lock "cinder-07641d6b-1d98-4d41-b57a-0204ad1d7d6c-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:04 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9" returned: 0 in 0.452s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:04 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e 1G Jul 21 08:22:04 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (586fe108-c029-4f9e-ac87-73595ce1ae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727e7901-84b5-467a-b248-0fdd419318c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (727e7901-84b5-467a-b248-0fdd419318c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320700324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06823e9b-c602-4ae2-9f6f-41404001b5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:05Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da06f89-5ca6-47ef-832d-21e1e0be7813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da06f89-5ca6-47ef-832d-21e1e0be7813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862ea78-de20-47d3-a7de-00d5d086e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f862ea78-de20-47d3-a7de-00d5d086e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06823e9b-c602-4ae2-9f6f-41404001b5b8', 'volume_name': 'volume-06823e9b-c602-4ae2-9f6f-41404001b5b8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d933d1-108c-437f-ab77-8b4f7a5abbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d933d1-108c-437f-ab77-8b4f7a5abbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3efb98-b4ba-468e-88d4-a5a65472c528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:04 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Volume 06823e9b-c602-4ae2-9f6f-41404001b5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06823e9b-c602-4ae2-9f6f-41404001b5b8', 'volume_size': 1} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:04 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e 1G" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8089d243-9205-4194-a003-7442d60233b9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:04 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8089d243-9205-4194-a003-7442d60233b9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e Jul 21 08:22:04 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:05 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8089d243-9205-4194-a003-7442d60233b9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e" returned: 0 in 0.306s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:05 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e is being set with open permissions: ugo+rw Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:05 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e Jul 21 08:22:05 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:05 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e" returned: 0 in 0.278s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:05 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info Jul 21 08:22:05 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:05 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info" returned: 0 in 0.336s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:05 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info is being set with open permissions: ugo+rw Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:05 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info Jul 21 08:22:05 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6b3105c1-2a18-4a05-942e-3b6bd9276bd6 req-f59d0507-22ca-4aea-bf74-8e64dc5c903a tempest-TestShelveInstance-1478294953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:06 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.info" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1320700324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06823e9b-c602-4ae2-9f6f-41404001b5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:05Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Creating volume 06823e9b-c602-4ae2-9f6f-41404001b5b8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:06 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:06 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 1073741824 Jul 21 08:22:06 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:06 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a49da108-10d6-4dc3-89d3-67a4d86fb7cb tempest-CinderUnicodeTest-693818582 None] Create snapshot completed successfully Jul 21 08:22:06 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 1073741824" returned: 0 in 0.511s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:06 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 Jul 21 08:22:06 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:06 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6b3105c1-2a18-4a05-942e-3b6bd9276bd6 req-f59d0507-22ca-4aea-bf74-8e64dc5c903a tempest-TestShelveInstance-1478294953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.054s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-6b3105c1-2a18-4a05-942e-3b6bd9276bd6 req-f59d0507-22ca-4aea-bf74-8e64dc5c903a tempest-TestShelveInstance-1478294953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3efb98-b4ba-468e-88d4-a5a65472c528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06823e9b-c602-4ae2-9f6f-41404001b5b8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129d0821-f628-48e2-be77-ef790a7619c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Volume volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 (06823e9b-c602-4ae2-9f6f-41404001b5b8): created successfully Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129d0821-f628-48e2-be77-ef790a7619c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (586fe108-c029-4f9e-ac87-73595ce1ae39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8530acf3-77a8-409e-956e-56eab40b4122 tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-6b3105c1-2a18-4a05-942e-3b6bd9276bd6 req-f59d0507-22ca-4aea-bf74-8e64dc5c903a tempest-TestShelveInstance-1478294953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-10956e34-00b6-46d8-b133-36c2155338d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c09d424-f4ff-4f4e-9065-3583001a7229', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-19d31019-69d5-4731-b7b9-2c70ab91487e-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-19d31019-69d5-4731-b7b9-2c70ab91487e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-quobyte-19d31019-69d5-4731-b7b9-2c70ab91487e" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-6b3105c1-2a18-4a05-942e-3b6bd9276bd6 req-f59d0507-22ca-4aea-bf74-8e64dc5c903a tempest-TestShelveInstance-1478294953 None] attachment_update completed successfully. Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-19d31019-69d5-4731-b7b9-2c70ab91487e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Deleting offline snapshot 19d31019-69d5-4731-b7b9-2c70ab91487e of volume 8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] snapshot_file for this snap is: volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d060f7ab-2fd4-4220-ae81-29be35c9421d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:07 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e Jul 21 08:22:07 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:07 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e" returned: 0 in 0.419s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8089d243-9205-4194-a003-7442d60233b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[793dfee8-a2a1-4117-8490-fbaf51a48110]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:07 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 Jul 21 08:22:07 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:07 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9" returned: 0 in 0.399s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:08 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e Jul 21 08:22:08 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-06823e9b-c602-4ae2-9f6f-41404001b5b8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-06823e9b-c602-4ae2-9f6f-41404001b5b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-quobyte-06823e9b-c602-4ae2-9f6f-41404001b5b8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-06823e9b-c602-4ae2-9f6f-41404001b5b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4cab30-c129-44cc-8c39-7db23bae35eb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:08 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 Jul 21 08:22:08 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:08 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e" returned: 0 in 0.541s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:08 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e Jul 21 08:22:08 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:08 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9.19d31019-69d5-4731-b7b9-2c70ab91487e" returned: 0 in 0.398s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:08 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8" returned: 0 in 0.803s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-19d31019-69d5-4731-b7b9-2c70ab91487e" released by "_delete_snapshot" :: held 1.929s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" released by "delete_snapshot" :: held 1.967s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:09 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8 Jul 21 08:22:09 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Created reservations ['1fa1393e-c644-4141-a259-9e2b16233c37', 'e48a00f4-f860-4a08-b56c-9fe59c1b007e', '49114fe9-376e-45e6-9248-a59a6e15c79f', '46ed420d-163e-4284-921b-b93f586d38e0'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Delete snapshot completed successfully. Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c92915fa-8f8f-47c4-bcca-93287325e9f4 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-19d31019-69d5-4731-b7b9-2c70ab91487e-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:09 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-06823e9b-c602-4ae2-9f6f-41404001b5b8" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-06823e9b-c602-4ae2-9f6f-41404001b5b8" released by "delete_volume" :: held 1.348s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Created reservations ['5d3f560b-aa30-49c5-ac4e-302a67eaa351', '84307aac-e9f7-4dc9-8b5e-5bc0d4dedaeb', 'fb98429c-1227-43da-ad98-4e6baf0d2eba', '28938884-11b8-4086-9e97-aa8cb0958a54'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:09 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:09 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:09 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.241s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Deleted volume successfully. Jul 21 08:22:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ce311901-cca4-44d2-90f8-69056ccfdfd7 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-06823e9b-c602-4ae2-9f6f-41404001b5b8-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-8089d243-9205-4194-a003-7442d60233b9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-8089d243-9205-4194-a003-7442d60233b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fd4eea-3505-469c-a93d-79713b766f1c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:10 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 Jul 21 08:22:10 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:11 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:11 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9 Jul 21 08:22:11 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=111,cinder:UPDATE=131,cinder:DELETE=11,cinder:INSERT=43 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=125,cinder:INSERT=39,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (8681d0d3-7e47-4590-b4a7-cf61ad7cf690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d75a9-2857-4944-adef-3e4a6a161e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d75a9-2857-4944-adef-3e4a6a161e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047212707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fdd05a-f234-4e6f-ac74-4948d91feea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:11Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f207857-6ba3-49ed-9a26-2af1ae2ba3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f207857-6ba3-49ed-9a26-2af1ae2ba3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1279779c-024a-454a-b2f4-760bc5c8ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1279779c-024a-454a-b2f4-760bc5c8ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fdd05a-f234-4e6f-ac74-4948d91feea6', 'volume_name': 'volume-81fdd05a-f234-4e6f-ac74-4948d91feea6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159e799-c90a-4c96-a5b8-ff41a0b735d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d159e799-c90a-4c96-a5b8-ff41a0b735d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6aeca1-4baa-4b61-8ab7-3a035576326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Volume 81fdd05a-f234-4e6f-ac74-4948d91feea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fdd05a-f234-4e6f-ac74-4948d91feea6', 'volume_size': 1} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047212707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fdd05a-f234-4e6f-ac74-4948d91feea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:11Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Creating volume 81fdd05a-f234-4e6f-ac74-4948d91feea6 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:11 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 1073741824 Jul 21 08:22:11 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:11 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-8089d243-9205-4194-a003-7442d60233b9" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-8089d243-9205-4194-a003-7442d60233b9" released by "delete_volume" :: held 0.918s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Created reservations ['3b4ba9d5-22bf-4e38-8ce9-249fa0a19e5d', '3d9b78f2-07ef-4506-96b9-a5933bae8c74', '27cb5930-4240-4065-946e-3c6a71e59062', 'b20eee53-5f92-46c4-b2e9-fcb0063eb793'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:11 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:11 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "cinder-quobyte-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[50051ae6-fb83-4b58-bc7e-3f1cc9ede09e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:11 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:11 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f Jul 21 08:22:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 1073741824" returned: 0 in 0.662s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:11 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:12 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.416s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Deleted volume successfully. Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-039d38dd-e883-40e7-8956-9c0ac31df731 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-8089d243-9205-4194-a003-7442d60233b9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:12 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 Jul 21 08:22:12 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:12 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6" returned: 0 in 0.302s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6aeca1-4baa-4b61-8ab7-3a035576326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fdd05a-f234-4e6f-ac74-4948d91feea6', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5ec77e-9c19-4c7a-91d2-8817efc7dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Volume volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 (81fdd05a-f234-4e6f-ac74-4948d91feea6): created successfully Jul 21 08:22:12 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5ec77e-9c19-4c7a-91d2-8817efc7dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (8681d0d3-7e47-4590-b4a7-cf61ad7cf690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" returned: 0 in 0.571s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3cc030d9-994e-4f73-814d-707746dbf83c tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:22:12 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f Jul 21 08:22:12 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:12 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" returned: 0 in 0.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-quobyte-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f" released by "delete_volume" :: held 0.942s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Created reservations ['901d89d3-1a60-4768-b119-e2b9c51f9db0', '8ed70e6f-e779-4897-90ed-0fc714ebecb8', 'bbaedc13-c236-4770-a092-e6e47ce3c966', '35b8a6d9-5ed6-4171-b193-2d5dc92c65df'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:12 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:12 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:13 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.312s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Deleted volume successfully. Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-038f7773-8c52-47fe-a88f-21ffa6e9a759 tempest-CinderUnicodeTest-693818582 None] Lock "cinder-c7d60c11-ea8d-4d6e-9ec0-124526e1e32f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-81fdd05a-f234-4e6f-ac74-4948d91feea6-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-81fdd05a-f234-4e6f-ac74-4948d91feea6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "cinder-quobyte-81fdd05a-f234-4e6f-ac74-4948d91feea6" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-81fdd05a-f234-4e6f-ac74-4948d91feea6" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acf0a7c-fd45-44ca-8bd9-2081f393fc63]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:13 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 Jul 21 08:22:13 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:14 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6" returned: 0 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:14 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6 Jul 21 08:22:14 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:14 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-81fdd05a-f234-4e6f-ac74-4948d91feea6" returned: 0 in 0.551s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-quobyte-81fdd05a-f234-4e6f-ac74-4948d91feea6" released by "delete_volume" :: held 1.094s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:14 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Created reservations ['4ef29452-9d0e-41df-8aea-94cd8256adec', 'b189be64-91ff-4f4c-a51f-0e6dfe675278', 'c09d2139-05fe-4acf-86f4-38108b867f71', '562106fa-0cdc-4370-8c13-2f8349aa571e'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:15 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:15 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:15 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.452s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Deleted volume successfully. Jul 21 08:22:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e0959ef8-a245-4ace-bd23-963161050148 tempest-VolumesActionsTest-1931663130 None] Lock "cinder-81fdd05a-f234-4e6f-ac74-4948d91feea6-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (1d8ef4ef-dd78-4084-8500-9d86b012fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c14402d-cf6e-436b-ae0a-421fb553d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c14402d-cf6e-436b-ae0a-421fb553d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-467846579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8fc71-2298-404f-8760-5156c97442f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:17Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e056a178-d5d9-48f8-8684-9fc90bf4a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e056a178-d5d9-48f8-8684-9fc90bf4a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b299c818-6648-472c-8f43-51c74f48f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b299c818-6648-472c-8f43-51c74f48f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a8fc71-2298-404f-8760-5156c97442f8', 'volume_name': 'volume-70a8fc71-2298-404f-8760-5156c97442f8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d41d5-dfc8-430d-acca-6a486e75e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5d41d5-dfc8-430d-acca-6a486e75e337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab0b76d-201e-49fe-a07e-ab1335e99ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Volume 70a8fc71-2298-404f-8760-5156c97442f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a8fc71-2298-404f-8760-5156c97442f8', 'volume_size': 1} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-467846579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a8fc71-2298-404f-8760-5156c97442f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ec6afb3c194d2786fba1cd42e00a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:17Z,use_quota=True,user_id='b694e500a026476a8b3603603fc5d35e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Creating volume 70a8fc71-2298-404f-8760-5156c97442f8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:16 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:16 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 1073741824 Jul 21 08:22:16 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:17 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 1073741824" returned: 0 in 0.487s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:17 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 Jul 21 08:22:17 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:17 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8" returned: 0 in 0.431s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab0b76d-201e-49fe-a07e-ab1335e99ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a8fc71-2298-404f-8760-5156c97442f8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca6902-f664-4983-9b44-6f891348bbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Volume volume-70a8fc71-2298-404f-8760-5156c97442f8 (70a8fc71-2298-404f-8760-5156c97442f8): created successfully Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca6902-f664-4983-9b44-6f891348bbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Flow 'volume_create_manager' (1d8ef4ef-dd78-4084-8500-9d86b012fc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-38365e64-4036-4df0-ad8a-4111e00b0380 tempest-VolumesActionsTest-2136394100 None] Created volume successfully. Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-70a8fc71-2298-404f-8760-5156c97442f8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-70a8fc71-2298-404f-8760-5156c97442f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "cinder-quobyte-70a8fc71-2298-404f-8760-5156c97442f8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-quobyte-70a8fc71-2298-404f-8760-5156c97442f8" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1110150e-ec32-4b26-a425-4c685c11f2de]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:19 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 Jul 21 08:22:19 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:20 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8" returned: 0 in 0.402s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:20 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8 Jul 21 08:22:20 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:20 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70a8fc71-2298-404f-8760-5156c97442f8" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-quobyte-70a8fc71-2298-404f-8760-5156c97442f8" released by "delete_volume" :: held 0.707s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Created reservations ['4760f298-0291-479b-a4b8-e933a86c365c', '0e70acba-6cab-4ec5-bb61-9435402bf72d', 'b38862b9-55d1-47c9-b4b6-b8486ac79982', '2123e132-29d7-4d42-8186-f3c0bbe99d51'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:20 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:20 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:20 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Deleted volume successfully. Jul 21 08:22:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c1edcdda-66c6-420a-9563-a106a99a0d86 tempest-VolumesActionsTest-2136394100 None] Lock "cinder-70a8fc71-2298-404f-8760-5156c97442f8-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:22:35 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:22:35 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Flow 'volume_create_manager' (17a739f5-82af-4691-9c36-462797671659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf355350-bb9b-49ca-b5c9-533a2c23d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf355350-bb9b-49ca-b5c9-533a2c23d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1816001411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42cb3a0-4317-4185-9c89-f6ba70da1388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae24f28cfeb497a82140ddd82dc9f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:36Z,use_quota=True,user_id='c8595dbc0cb44b8596c75dd75561c13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf90cb0d-8943-4bef-bc7d-f1231717413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf90cb0d-8943-4bef-bc7d-f1231717413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b833df8-d561-4fc1-8eb7-7fff70c1a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b833df8-d561-4fc1-8eb7-7fff70c1a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a42cb3a0-4317-4185-9c89-f6ba70da1388', 'volume_name': 'volume-a42cb3a0-4317-4185-9c89-f6ba70da1388', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a022fc44-745b-464f-9f01-9f526c715d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a022fc44-745b-464f-9f01-9f526c715d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a3528c-05da-44a4-aef0-5d8697f7ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:36 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Volume a42cb3a0-4317-4185-9c89-f6ba70da1388: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a42cb3a0-4317-4185-9c89-f6ba70da1388', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Trying to clone a42cb3a0-4317-4185-9c89-f6ba70da1388 from image a3f8b652-69e7-49da-931e-22bcdb879c31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:22:36 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Image download 20.69 MB at 20.69 MB/s Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5303f8ee-bafb-45af-83c0-fe0b38a359b2]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:36 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD Jul 21 08:22:36 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:37 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 is fetched for user c8595dbc0cb44b8596c75dd75561c13e. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc221c3-640a-4e99-9c4a-7abf4f1bddac]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:37 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD Jul 21 08:22:37 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:37 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1816001411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a42cb3a0-4317-4185-9c89-f6ba70da1388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae24f28cfeb497a82140ddd82dc9f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:36Z,use_quota=True,user_id='c8595dbc0cb44b8596c75dd75561c13e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Creating volume a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:37 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:37 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1073741824 Jul 21 08:22:37 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:38 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1073741824" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:38 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 Jul 21 08:22:38 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:38 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388" returned: 0 in 0.391s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Attempting download of a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume a42cb3a0-4317-4185-9c89-f6ba70da1388. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f577189-3c88-4d38-805a-2763ff1f3bb3]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-c3894e5e-498b-4bdd-9e15-1658b126c7e2 req-58ceeb00-1c05-46b4-82d3-d3ce058af0c4 tempest-TestShelveInstance-1478294953 None] Terminate volume connection completed successfully. Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-c3894e5e-498b-4bdd-9e15-1658b126c7e2 req-58ceeb00-1c05-46b4-82d3-d3ce058af0c4 tempest-TestShelveInstance-1478294953 None] Deleting attachment 4c09d424-f4ff-4f4e-9065-3583001a7229. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:22:38 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb Jul 21 08:22:38 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:38 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb" returned: 0 in 0.338s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:39 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb Jul 21 08:22:39 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:39 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb" returned: 1 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3f8b652-69e7-49da-931e-22bcdb879c31_071f2bvb' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eafc41c-80cc-4352-9ac0-45ea21a398de]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:39 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD Jul 21 08:22:39 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:39 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] a3f8b652-69e7-49da-931e-22bcdb879c31 was qcow2, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:22:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:39 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 Jul 21 08:22:39 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-86320611-fe4e-407a-b617-a573fafd1d8b req-62487ee3-1c5b-422a-8c0b-5055283bce16 tempest-TestShelveInstance-1478294953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-86320611-fe4e-407a-b617-a573fafd1d8b req-62487ee3-1c5b-422a-8c0b-5055283bce16 tempest-TestShelveInstance-1478294953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-86320611-fe4e-407a-b617-a573fafd1d8b req-62487ee3-1c5b-422a-8c0b-5055283bce16 tempest-TestShelveInstance-1478294953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-86320611-fe4e-407a-b617-a573fafd1d8b req-62487ee3-1c5b-422a-8c0b-5055283bce16 tempest-TestShelveInstance-1478294953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-10956e34-00b6-46d8-b133-36c2155338d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b8f5894-db94-46ea-8391-3e83f6eddd54', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:22:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-86320611-fe4e-407a-b617-a573fafd1d8b req-62487ee3-1c5b-422a-8c0b-5055283bce16 tempest-TestShelveInstance-1478294953 None] attachment_update completed successfully. Jul 21 08:22:41 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388" returned: 0 in 1.788s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3f8b652-69e7-49da-931e-22bcdb879c31_8cojdyt7devstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:22:41 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Converted 112.00 MB image at 62.58 MB/s Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:41 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1G Jul 21 08:22:41 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:41 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 1G" returned: 0 in 0.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Downloaded image a3f8b652-69e7-49da-931e-22bcdb879c31 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}])) to volume a42cb3a0-4317-4185-9c89-f6ba70da1388 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Temporary image a3f8b652-69e7-49da-931e-22bcdb879c31 for user c8595dbc0cb44b8596c75dd75561c13e is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Marking volume a42cb3a0-4317-4185-9c89-f6ba70da1388 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Copying metadata from image a3f8b652-69e7-49da-931e-22bcdb879c31 to a42cb3a0-4317-4185-9c89-f6ba70da1388. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Creating volume glance metadata for volume a42cb3a0-4317-4185-9c89-f6ba70da1388 backed by image a3f8b652-69e7-49da-931e-22bcdb879c31 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a3528c-05da-44a4-aef0-5d8697f7ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a42cb3a0-4317-4185-9c89-f6ba70da1388', 'volume_size': 1, 'image_id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3f8b652-69e7-49da-931e-22bcdb879c31', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8bfe844e6b884c868a45f6150a978228', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a3f8b652-69e7-49da-931e-22bcdb879c31', 'created_at': datetime.datetime(2026, 7, 21, 6, 3, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 3, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3f8b652-69e7-49da-931e-22bcdb879c31/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55d83c8-3156-4438-b994-a74529094896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:41 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Volume volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 (a42cb3a0-4317-4185-9c89-f6ba70da1388): created successfully Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55d83c8-3156-4438-b994-a74529094896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Flow 'volume_create_manager' (17a739f5-82af-4691-9c36-462797671659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-942070ac-9550-4de5-af4f-8c9554aa9d84 tempest-VolumesImageMetadata-813217872 None] Created volume successfully. Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Acquiring lock "cinder-a42cb3a0-4317-4185-9c89-f6ba70da1388-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "cinder-a42cb3a0-4317-4185-9c89-f6ba70da1388-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Acquiring lock "cinder-quobyte-a42cb3a0-4317-4185-9c89-f6ba70da1388" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "cinder-quobyte-a42cb3a0-4317-4185-9c89-f6ba70da1388" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a4a61-d87a-460a-a3f5-a292a31c92a8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:42 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 Jul 21 08:22:42 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:43 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388" returned: 0 in 0.391s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:43 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388 Jul 21 08:22:43 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:43 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-a42cb3a0-4317-4185-9c89-f6ba70da1388" returned: 0 in 0.434s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "cinder-quobyte-a42cb3a0-4317-4185-9c89-f6ba70da1388" released by "delete_volume" :: held 0.895s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Created reservations ['eca2d024-c06f-4a82-b025-b5f0be502518', '27259109-d775-4591-8a8d-8a67b033365e', 'eea709b7-281b-4f6f-8f99-6553d673b79c', '05f471d2-be24-4e6e-ba69-0173bb9d21e1'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:43 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:43 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:44 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.359s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:44 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Deleted volume successfully. Jul 21 08:22:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-941744c2-e0ef-4df8-be30-ede3ed96af97 tempest-VolumesImageMetadata-813217872 None] Lock "cinder-a42cb3a0-4317-4185-9c89-f6ba70da1388-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Flow 'volume_create_manager' (d07f419f-e076-4e89-9ad0-4fe7fa735575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d610dd-2cc1-40a7-92dd-9f3761fcf736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d610dd-2cc1-40a7-92dd-9f3761fcf736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-490793107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a0a0c7-9009-4a04-8528-d3452126da48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb37dbbf73426dba512e1fce0c5b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:48Z,use_quota=True,user_id='84b33f6c20d1478eaeafe2d887db5bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc63cde-96fe-4ee2-8086-db569677eacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc63cde-96fe-4ee2-8086-db569677eacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846bce7f-7aba-435d-9dfa-f0421ed03cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846bce7f-7aba-435d-9dfa-f0421ed03cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a0a0c7-9009-4a04-8528-d3452126da48', 'volume_name': 'volume-c4a0a0c7-9009-4a04-8528-d3452126da48', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76dfa5-94a5-4cbc-8e34-259eec5eebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc76dfa5-94a5-4cbc-8e34-259eec5eebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58f3b9e-03b7-47fc-8274-024644ea105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Volume c4a0a0c7-9009-4a04-8528-d3452126da48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a0a0c7-9009-4a04-8528-d3452126da48', 'volume_size': 1} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-490793107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a0a0c7-9009-4a04-8528-d3452126da48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bb37dbbf73426dba512e1fce0c5b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:48Z,use_quota=True,user_id='84b33f6c20d1478eaeafe2d887db5bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Creating volume c4a0a0c7-9009-4a04-8528-d3452126da48 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:48 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:48 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 1073741824 Jul 21 08:22:48 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:48 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 1073741824" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:48 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 Jul 21 08:22:48 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:48 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b58f3b9e-03b7-47fc-8274-024644ea105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a0a0c7-9009-4a04-8528-d3452126da48', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8d9ea1-6ec0-4e1a-8bb5-8f7c1a6b0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Volume volume-c4a0a0c7-9009-4a04-8528-d3452126da48 (c4a0a0c7-9009-4a04-8528-d3452126da48): created successfully Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8d9ea1-6ec0-4e1a-8bb5-8f7c1a6b0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Flow 'volume_create_manager' (d07f419f-e076-4e89-9ad0-4fe7fa735575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-64276f36-df0b-48be-a593-51999c7fedf6 tempest-AbsoluteLimitsTests-2088449385 None] Created volume successfully. Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Acquiring lock "cinder-c4a0a0c7-9009-4a04-8528-d3452126da48-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "cinder-c4a0a0c7-9009-4a04-8528-d3452126da48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Acquiring lock "cinder-quobyte-c4a0a0c7-9009-4a04-8528-d3452126da48" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "cinder-quobyte-c4a0a0c7-9009-4a04-8528-d3452126da48" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3185bb7-da7b-4109-b0dc-886cdd291c74]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:50 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 Jul 21 08:22:50 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:50 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48" returned: 0 in 0.368s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:50 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48 Jul 21 08:22:50 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:50 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c4a0a0c7-9009-4a04-8528-d3452126da48" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "cinder-quobyte-c4a0a0c7-9009-4a04-8528-d3452126da48" released by "delete_volume" :: held 0.652s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Created reservations ['d8442a66-4a5c-42b3-b8e5-671945ed2203', '734d3119-dbc2-48b7-b234-4cc57dc38716', '4130dc68-7d9b-4209-83d4-3e56a479003c', '976ca61a-40de-4312-9d7e-8c1dc582199b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:51 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:51 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:51 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.247s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:51 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Deleted volume successfully. Jul 21 08:22:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d5205cd9-0298-4bac-9393-cd77e25fd693 tempest-AbsoluteLimitsTests-2088449385 None] Lock "cinder-c4a0a0c7-9009-4a04-8528-d3452126da48-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:52 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:52 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:52 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:22:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Flow 'volume_create_manager' (e61f0dfa-d699-4386-890d-417679977001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adc70c2-7522-4891-9803-5cbe118c320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adc70c2-7522-4891-9803-5cbe118c320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-172738200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0922198d8155412bacc33ec1bd3f7551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:55Z,use_quota=True,user_id='71ec113fa84e465784e631509580b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bec2c34-f384-4aa7-a42a-a81a2aa426d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bec2c34-f384-4aa7-a42a-a81a2aa426d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc394e47-edaa-4cfe-b3ec-92904e68fe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc394e47-edaa-4cfe-b3ec-92904e68fe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb', 'volume_name': 'volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb', 'volume_size': 2}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaf97df-314c-41b4-9d66-8b5654cfda14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaf97df-314c-41b4-9d66-8b5654cfda14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e38ee66-36d7-462c-9ceb-b488a564e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:55 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Volume 2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb', 'volume_size': 2} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-172738200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0922198d8155412bacc33ec1bd3f7551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:22:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:22:55Z,use_quota=True,user_id='71ec113fa84e465784e631509580b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Creating volume 2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:22:55 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:22:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb 2147483648 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:55 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb 2147483648 Jul 21 08:22:55 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:56 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb 2147483648" returned: 0 in 0.462s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:56 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb Jul 21 08:22:56 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:56 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e38ee66-36d7-462c-9ceb-b488a564e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb', 'volume_size': 2}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10218984-e212-4655-adf9-f5e0587a6132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:22:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Volume volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb (2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb): created successfully Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10218984-e212-4655-adf9-f5e0587a6132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Flow 'volume_create_manager' (e61f0dfa-d699-4386-890d-417679977001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:22:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ba23f06f-00ab-4e02-be59-98de9121f8b8 tempest-VolumesCloneNegativeTest-2046516538 None] Created volume successfully. Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Acquiring lock "cinder-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "cinder-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Acquiring lock "cinder-quobyte-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "cinder-quobyte-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed8787-8f82-429b-8310-e1f5aa066f0c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:22:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:56 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb Jul 21 08:22:56 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:57 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" returned: 0 in 0.356s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:57 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb Jul 21 08:22:57 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:57 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "cinder-quobyte-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb" released by "delete_volume" :: held 0.642s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Created reservations ['6e0606a8-5ede-4c43-a150-7bc7697a18b0', 'cc78da27-6666-41d5-bef0-3bb3645c4a28', '7aa0ab56-00f9-4b53-8ee3-3eb3822c05cf', '5767cc9d-658c-47e5-9ef3-980e857bff46'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:22:57 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:22:57 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:22:57 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.243s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:22:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Deleted volume successfully. Jul 21 08:22:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-595502e0-b149-46f4-93ac-b5f6f34e5e7c tempest-VolumesCloneNegativeTest-2046516538 None] Lock "cinder-2fa8c87e-4da2-4e82-a00c-e12c6a8a4deb-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Flow 'volume_create_manager' (9f6fc489-b458-4a22-8999-e6b7866ce06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac440d1b-02a5-4352-9272-f488e631d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac440d1b-02a5-4352-9272-f488e631d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-147737193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab90bd7-3b07-4e8d-b35d-5afe9f2242de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e850baaef8f4ddb925a84496bb532b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:03Z,use_quota=True,user_id='444052d637ea45379d27e66ee631ec4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05708e59-c4cc-43df-a04d-70f03f4c2a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05708e59-c4cc-43df-a04d-70f03f4c2a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c5d59-a4c1-46e2-99ab-94118be624f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c5d59-a4c1-46e2-99ab-94118be624f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab90bd7-3b07-4e8d-b35d-5afe9f2242de', 'volume_name': 'volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be55bd5-2306-4b10-84f5-1e927311ad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be55bd5-2306-4b10-84f5-1e927311ad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8204d41-9b23-47be-838a-7b2345ec1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:02 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Volume 0ab90bd7-3b07-4e8d-b35d-5afe9f2242de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de', 'volume_size': 1} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-147737193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab90bd7-3b07-4e8d-b35d-5afe9f2242de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e850baaef8f4ddb925a84496bb532b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:03Z,use_quota=True,user_id='444052d637ea45379d27e66ee631ec4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Creating volume 0ab90bd7-3b07-4e8d-b35d-5afe9f2242de {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:02 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:02 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de 1073741824 Jul 21 08:23:02 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:03 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de 1073741824" returned: 0 in 0.408s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:03 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de Jul 21 08:23:03 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:03 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" returned: 0 in 0.240s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8204d41-9b23-47be-838a-7b2345ec1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46003cad-32b3-4452-ab6f-d936a5af1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:03 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Volume volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de (0ab90bd7-3b07-4e8d-b35d-5afe9f2242de): created successfully Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46003cad-32b3-4452-ab6f-d936a5af1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:03 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Flow 'volume_create_manager' (9f6fc489-b458-4a22-8999-e6b7866ce06b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:03 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-099866d0-fc0e-4587-b38f-1c3c6f3bf9ed tempest-VolumesNegativeTest-1687305726 None] Created volume successfully. Jul 21 08:23:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-63c1063f-634f-4547-8f31-cdf910e266ee req-e214d669-2e41-4299-89b0-cc36bcd478a5 tempest-TestShelveInstance-1478294953 None] Terminate volume connection completed successfully. Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-63c1063f-634f-4547-8f31-cdf910e266ee req-e214d669-2e41-4299-89b0-cc36bcd478a5 tempest-TestShelveInstance-1478294953 None] Deleting attachment 6b8f5894-db94-46ea-8391-3e83f6eddd54. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Acquiring lock "cinder-10956e34-00b6-46d8-b133-36c2155338d3-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "cinder-10956e34-00b6-46d8-b133-36c2155338d3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Acquiring lock "cinder-quobyte-10956e34-00b6-46d8-b133-36c2155338d3" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "cinder-quobyte-10956e34-00b6-46d8-b133-36c2155338d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c85bc1-d1a0-456e-94e0-9c758e43cd59]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:09 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 Jul 21 08:23:09 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:09 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3" returned: 0 in 0.734s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:09 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3 Jul 21 08:23:09 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:10 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-10956e34-00b6-46d8-b133-36c2155338d3" returned: 0 in 0.444s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "cinder-quobyte-10956e34-00b6-46d8-b133-36c2155338d3" released by "delete_volume" :: held 1.250s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.quota [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Created reservations ['6bf88fb7-a981-4c6c-b674-52eaa06861e4', '54b48428-2626-4c26-beb6-67d1dd8ec60c', 'f7e1df07-6e2e-4bc4-8115-63e67fed256f', '16cc06b7-8ae9-448c-ad4d-92aa6f0452d6'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:10 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:10 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:10 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.416s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.manager [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Deleted volume successfully. Jul 21 08:23:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [req-63c1063f-634f-4547-8f31-cdf910e266ee req-62b0fd15-94eb-4906-8281-da36f47220ae tempest-TestShelveInstance-1478294953 None] Lock "cinder-10956e34-00b6-46d8-b133-36c2155338d3-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:20 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=42,cinder:UPDATE=48,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:23:20 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=5 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (75ff0a49-233f-4cff-a581-690afb7f1efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0a3a1-73f7-4fcb-8cc3-66f295f272b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0a3a1-73f7-4fcb-8cc3-66f295f272b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607317802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb266ca8-320f-4e2a-98ad-33f358a61874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:22Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b53635-78be-4545-aec8-37f7b5fe7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b53635-78be-4545-aec8-37f7b5fe7143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533e1026-3f2a-4889-b758-85d76149cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533e1026-3f2a-4889-b758-85d76149cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb266ca8-320f-4e2a-98ad-33f358a61874', 'volume_name': 'volume-eb266ca8-320f-4e2a-98ad-33f358a61874', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf0e310-e90e-474a-ab0d-a1cfee7cc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf0e310-e90e-474a-ab0d-a1cfee7cc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d22835-b3ab-4869-8195-af86e6c7b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume eb266ca8-320f-4e2a-98ad-33f358a61874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb266ca8-320f-4e2a-98ad-33f358a61874', 'volume_size': 1} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607317802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb266ca8-320f-4e2a-98ad-33f358a61874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:22Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume eb266ca8-320f-4e2a-98ad-33f358a61874 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:21 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 1073741824 Jul 21 08:23:21 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Acquiring lock "cinder-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "cinder-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Acquiring lock "cinder-quobyte-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "cinder-quobyte-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b38e1e-8db9-4eb6-a43d-5f06ac07d1d2]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:22 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de Jul 21 08:23:22 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:22 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 1073741824" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:22 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 Jul 21 08:23:22 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:22 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" returned: 0 in 0.380s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:22 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de Jul 21 08:23:22 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:22 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d22835-b3ab-4869-8195-af86e6c7b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb266ca8-320f-4e2a-98ad-33f358a61874', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fe8fcd-8549-411d-b353-906510700b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:22 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-eb266ca8-320f-4e2a-98ad-33f358a61874 (eb266ca8-320f-4e2a-98ad-33f358a61874): created successfully Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fe8fcd-8549-411d-b353-906510700b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (75ff0a49-233f-4cff-a581-690afb7f1efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4352dd26-328f-43af-b57f-8d863befc7b8 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:22 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "cinder-quobyte-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de" released by "delete_volume" :: held 0.672s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Created reservations ['02d8ea63-7c59-4635-bbc7-e71506ed51a3', '857e34b2-df68-4114-a00f-558a7e8b34c6', '0e3e9c70-3f27-4a5c-9910-66fd573f368f', '1d8ec45a-eda9-40e2-85fa-e81bb7dc3ea8'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:22 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:22 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:23 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.257s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Deleted volume successfully. Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bc4df157-bd3e-42b2-801b-6960510db9e9 tempest-VolumesNegativeTest-1687305726 None] Lock "cinder-0ab90bd7-3b07-4e8d-b35d-5afe9f2242de-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (4de574a4-7209-4169-8573-69e11566236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4285d2-7594-40ef-bbf0-7241cf1b5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4285d2-7594-40ef-bbf0-7241cf1b5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594695949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df7d4f0-2c03-4675-862e-b70fd543efc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:23Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d6e58-0cfb-45f1-ab1e-97d5eab65fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093d6e58-0cfb-45f1-ab1e-97d5eab65fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4880efc0-b4d5-4d79-bb54-40b1ab664a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4880efc0-b4d5-4d79-bb54-40b1ab664a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df7d4f0-2c03-4675-862e-b70fd543efc2', 'volume_name': 'volume-2df7d4f0-2c03-4675-862e-b70fd543efc2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74644617-7ec4-4a31-ae84-3f343620a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74644617-7ec4-4a31-ae84-3f343620a165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667abefc-cd66-4e76-9f7b-a9d5d0c88185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume 2df7d4f0-2c03-4675-862e-b70fd543efc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df7d4f0-2c03-4675-862e-b70fd543efc2', 'volume_size': 1} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594695949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df7d4f0-2c03-4675-862e-b70fd543efc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:23Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume 2df7d4f0-2c03-4675-862e-b70fd543efc2 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:23 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:23 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 1073741824 Jul 21 08:23:23 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (e08252ee-9f1f-4404-82f6-617680d5fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac0c031-207f-4c22-8a4f-2df7ead66d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac0c031-207f-4c22-8a4f-2df7ead66d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934821704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3c2d7b-77cb-4c56-9caa-e16e64bdb713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0171415e-c6c0-46ba-af74-27cc6b8f289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0171415e-c6c0-46ba-af74-27cc6b8f289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05e1d8d-fefd-4557-a89d-3bc28cb86907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05e1d8d-fefd-4557-a89d-3bc28cb86907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3c2d7b-77cb-4c56-9caa-e16e64bdb713', 'volume_name': 'volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d19e956-7901-4a07-8487-3dfda91ee9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d19e956-7901-4a07-8487-3dfda91ee9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabe0d4f-1526-445c-8395-f4694ebffa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:23 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume 9c3c2d7b-77cb-4c56-9caa-e16e64bdb713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713', 'volume_size': 1} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:23 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 1073741824" returned: 0 in 0.561s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:24 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 Jul 21 08:23:24 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (3fbe74a7-670d-4d25-b04f-2f51f1e8613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83b7e42-fba9-4c82-bcae-1f74c5bdc10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83b7e42-fba9-4c82-bcae-1f74c5bdc10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122915915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ff8ce0-0131-4414-a26f-b778a2ae41e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3253df-ca85-476d-909d-90f5a209af0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3253df-ca85-476d-909d-90f5a209af0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c870b4-8e26-467d-9871-a66d656d04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c870b4-8e26-467d-9871-a66d656d04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ff8ce0-0131-4414-a26f-b778a2ae41e7', 'volume_name': 'volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22bde93-f864-4d2c-89d6-5e37b4824571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22bde93-f864-4d2c-89d6-5e37b4824571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ef0ff-ec9c-4f35-8d44-500562d2244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume 34ff8ce0-0131-4414-a26f-b778a2ae41e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7', 'volume_size': 1} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:24 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934821704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3c2d7b-77cb-4c56-9caa-e16e64bdb713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume 9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:24 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:24 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 1073741824 Jul 21 08:23:24 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667abefc-cd66-4e76-9f7b-a9d5d0c88185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df7d4f0-2c03-4675-862e-b70fd543efc2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5bb0b8-6ee3-4f50-95d9-33f9061bf030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 (2df7d4f0-2c03-4675-862e-b70fd543efc2): created successfully Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5bb0b8-6ee3-4f50-95d9-33f9061bf030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (4de574a4-7209-4169-8573-69e11566236f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-68f8eeff-bd42-4658-910e-4db604b6e4c4 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (b4a77e91-8722-4027-a983-fd7bf802cdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1409a6-9bf3-4b7d-af86-bfcd6d18dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1409a6-9bf3-4b7d-af86-bfcd6d18dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089613365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4f9dbe-b354-467d-8467-e2dcd134060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77848a5-6775-4958-940e-d85d18f40124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77848a5-6775-4958-940e-d85d18f40124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95178789-9e9b-43ee-93bd-778ad4c037b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95178789-9e9b-43ee-93bd-778ad4c037b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4f9dbe-b354-467d-8467-e2dcd134060b', 'volume_name': 'volume-ec4f9dbe-b354-467d-8467-e2dcd134060b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63e585-1ecb-4cfb-87cf-84279f33f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63e585-1ecb-4cfb-87cf-84279f33f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279d2efa-01f2-4938-b6b8-1fe683064bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume ec4f9dbe-b354-467d-8467-e2dcd134060b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4f9dbe-b354-467d-8467-e2dcd134060b', 'volume_size': 1} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:24 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 1073741824" returned: 0 in 0.631s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:25 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 Jul 21 08:23:25 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (d14fdf7f-8960-4e84-b24f-a8b8948119c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcbc91b-84bc-4ce9-acff-5bfb03b2c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcbc91b-84bc-4ce9-acff-5bfb03b2c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75494133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5567b4f5-7fcb-44c3-840f-8933f42b4e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:25Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322776e4-a589-4d23-9c20-bbab3d07a081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322776e4-a589-4d23-9c20-bbab3d07a081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea74515f-68e0-41eb-aac1-6faf5b1fef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea74515f-68e0-41eb-aac1-6faf5b1fef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5567b4f5-7fcb-44c3-840f-8933f42b4e74', 'volume_name': 'volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd411ff-5cc0-4e80-a675-a79180e1dd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd411ff-5cc0-4e80-a675-a79180e1dd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e1210e-5d85-4fb6-a7f9-7985d7dbe3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume 5567b4f5-7fcb-44c3-840f-8933f42b4e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74', 'volume_size': 1} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:25 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" returned: 0 in 0.280s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.029s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1122915915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ff8ce0-0131-4414-a26f-b778a2ae41e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume 34ff8ce0-0131-4414-a26f-b778a2ae41e7 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:25 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabe0d4f-1526-445c-8395-f4694ebffa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 1073741824 Jul 21 08:23:25 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1503788f-21f7-48df-be7f-ecbc2b3667db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 (9c3c2d7b-77cb-4c56-9caa-e16e64bdb713): created successfully Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1503788f-21f7-48df-be7f-ecbc2b3667db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (e08252ee-9f1f-4404-82f6-617680d5fffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-724fa225-c6bd-49b4-8d4b-b582e5baa449 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:25 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 1073741824" returned: 0 in 0.449s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:25 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 Jul 21 08:23:25 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:26 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089613365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4f9dbe-b354-467d-8467-e2dcd134060b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:24Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume ec4f9dbe-b354-467d-8467-e2dcd134060b {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0ef0ff-ec9c-4f35-8d44-500562d2244c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:26 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b 1073741824 Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607b681d-ace9-4aa9-b379-18ec917a1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:26 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 (34ff8ce0-0131-4414-a26f-b778a2ae41e7): created successfully Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607b681d-ace9-4aa9-b379-18ec917a1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (3fbe74a7-670d-4d25-b04f-2f51f1e8613d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c3345e40-e378-4bdd-83c2-45e1f7eb33fe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:26 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b 1073741824" returned: 0 in 0.492s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:26 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b Jul 21 08:23:26 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:26 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75494133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5567b4f5-7fcb-44c3-840f-8933f42b4e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033dc3232c054b47b44e55979a1bb4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:25Z,use_quota=True,user_id='3fda6e5b49e74426a394a21fa931217d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Creating volume 5567b4f5-7fcb-44c3-840f-8933f42b4e74 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279d2efa-01f2-4938-b6b8-1fe683064bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4f9dbe-b354-467d-8467-e2dcd134060b', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a343f99-2cfb-486e-a18e-e53461b1adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:26 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 1073741824 Jul 21 08:23:26 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-ec4f9dbe-b354-467d-8467-e2dcd134060b (ec4f9dbe-b354-467d-8467-e2dcd134060b): created successfully Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a343f99-2cfb-486e-a18e-e53461b1adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (b4a77e91-8722-4027-a983-fd7bf802cdbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-67b00976-e4ba-4995-884d-59770386678d tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:27 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 1073741824" returned: 0 in 0.473s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:27 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 Jul 21 08:23:27 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:27 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e1210e-5d85-4fb6-a7f9-7985d7dbe3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ff00b6-fb6c-40c6-a67a-06c657bcbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:27 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Volume volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 (5567b4f5-7fcb-44c3-840f-8933f42b4e74): created successfully Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ff00b6-fb6c-40c6-a67a-06c657bcbca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:27 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Flow 'volume_create_manager' (d14fdf7f-8960-4e84-b24f-a8b8948119c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-321a049b-e6be-4682-a119-8ae34d19ed97 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created volume successfully. Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-5567b4f5-7fcb-44c3-840f-8933f42b4e74-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-5567b4f5-7fcb-44c3-840f-8933f42b4e74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-5567b4f5-7fcb-44c3-840f-8933f42b4e74" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-5567b4f5-7fcb-44c3-840f-8933f42b4e74" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c22d9e-4a99-4f81-afef-f51ec68650b1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:28 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 Jul 21 08:23:28 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:28 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:28 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74 Jul 21 08:23:28 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:29 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5567b4f5-7fcb-44c3-840f-8933f42b4e74" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-5567b4f5-7fcb-44c3-840f-8933f42b4e74" released by "delete_volume" :: held 0.672s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['7a6b6e8d-7457-4632-afb6-75d68226a115', '962a726d-9ef3-4505-8cfa-3dfcd27152a6', '6206f39e-b3ec-445a-bb35-1e0631c4fa31', 'c489ec4b-05c4-425d-8dcd-d2fc1655402d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:29 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:29 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:29 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.241s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0ed0b7b2-eeb2-4f99-ae32-c24f59b4a9e0 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-5567b4f5-7fcb-44c3-840f-8933f42b4e74-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-ec4f9dbe-b354-467d-8467-e2dcd134060b-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-ec4f9dbe-b354-467d-8467-e2dcd134060b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-ec4f9dbe-b354-467d-8467-e2dcd134060b" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-ec4f9dbe-b354-467d-8467-e2dcd134060b" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319a00c-96c5-41eb-8fe4-c3a18100ea4c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:29 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b Jul 21 08:23:29 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:30 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b" returned: 0 in 0.514s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:30 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b Jul 21 08:23:30 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:30 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ec4f9dbe-b354-467d-8467-e2dcd134060b" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-ec4f9dbe-b354-467d-8467-e2dcd134060b" released by "delete_volume" :: held 0.819s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['77ae4196-2308-4fbd-a42c-a11d5ff6caeb', '7cec7cf6-d0aa-415e-9945-2cc067fb1d20', 'e86028ab-8cb1-4337-bd38-db8f1d509c33', 'd1510f02-33d2-4ff6-8300-87857d8566d9'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:30 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:30 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-34ff8ce0-0131-4414-a26f-b778a2ae41e7-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-34ff8ce0-0131-4414-a26f-b778a2ae41e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-34ff8ce0-0131-4414-a26f-b778a2ae41e7" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-34ff8ce0-0131-4414-a26f-b778a2ae41e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a3cf7a-44f8-4f5c-8627-396fabd316ea]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:31 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.308s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-521303e7-088a-4225-8665-23fddb852dbe tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-ec4f9dbe-b354-467d-8467-e2dcd134060b-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:31 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 Jul 21 08:23:31 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:31 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:31 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7 Jul 21 08:23:31 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:31 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-34ff8ce0-0131-4414-a26f-b778a2ae41e7" returned: 0 in 0.245s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-34ff8ce0-0131-4414-a26f-b778a2ae41e7" released by "delete_volume" :: held 0.684s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['49259ae8-f00b-4f3c-b815-089d3e02c5b9', 'da1dbcf5-ac57-4581-96a6-523cb0e990f8', '5a4d4315-ad01-4995-9bde-57decfb6fb18', 'ccbe0e87-4e9a-4d1e-b97b-7c800907e783'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:31 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:31 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:32 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b91f4d8-9832-46c6-8d02-c1df15339026 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-34ff8ce0-0131-4414-a26f-b778a2ae41e7-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f8178-07a3-432f-b50a-74cca58f509e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:32 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 Jul 21 08:23:32 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:32 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" returned: 0 in 0.449s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:32 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713 Jul 21 08:23:32 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:32 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713" released by "delete_volume" :: held 0.755s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['e2e3e6bd-834a-4490-af9d-9f6d574d6740', 'd5a7f9f6-40e5-4ff2-bd71-2b2debd2ff38', '3e447a8f-cfaa-4a70-bb33-c9d0943d7f85', 'ed936002-e479-4a5a-bc78-940b686dcba4'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:33 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:33 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:33 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-2df7d4f0-2c03-4675-862e-b70fd543efc2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-2df7d4f0-2c03-4675-862e-b70fd543efc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7d924b3a-4058-47a8-8f59-17bffafa5706 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-9c3c2d7b-77cb-4c56-9caa-e16e64bdb713-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-2df7d4f0-2c03-4675-862e-b70fd543efc2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-2df7d4f0-2c03-4675-862e-b70fd543efc2" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab7043-028f-42dd-8b02-a75a81d91646]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:33 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 Jul 21 08:23:33 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:33 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2" returned: 0 in 0.394s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:33 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2 Jul 21 08:23:33 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:34 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-2df7d4f0-2c03-4675-862e-b70fd543efc2" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-2df7d4f0-2c03-4675-862e-b70fd543efc2" released by "delete_volume" :: held 0.693s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['123ff462-6da1-4dd4-89b4-6229ac02ab85', '1ef90eb9-af4f-47ce-a714-8706c9bfd1fb', '4a96324a-d8d4-4d96-bbe0-3d3854bedf87', '88c320ad-04bd-490c-9362-c38307a8d643'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:34 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:34 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:34 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.277s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-eb266ca8-320f-4e2a-98ad-33f358a61874-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d914bddb-9185-4c70-b286-ca58d777af33 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-2df7d4f0-2c03-4675-862e-b70fd543efc2-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-eb266ca8-320f-4e2a-98ad-33f358a61874-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "cinder-quobyte-eb266ca8-320f-4e2a-98ad-33f358a61874" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-eb266ca8-320f-4e2a-98ad-33f358a61874" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[14556c6b-d92c-4270-b80e-8756c03e9cd0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:34 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 Jul 21 08:23:34 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:35 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:35 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874 Jul 21 08:23:35 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:35 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-eb266ca8-320f-4e2a-98ad-33f358a61874" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-quobyte-eb266ca8-320f-4e2a-98ad-33f358a61874" released by "delete_volume" :: held 0.691s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Created reservations ['4696bc83-2fb1-4bfc-8fe5-6d29ba70d5f0', 'e0464474-4578-43ef-8e2c-d2c2e8aab8ab', 'dc2f6d30-def9-4d0d-82f5-bf93acd1c0bc', '8fcbc67e-b85a-4aa0-95bd-77cbac826bb7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:35 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:35 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:35 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.321s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Deleted volume successfully. Jul 21 08:23:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fe1e68fb-1d59-40a1-965f-e8334b2c6f94 tempest-CreateVolumesFromSourceVolumeTest-883896154 None] Lock "cinder-eb266ca8-320f-4e2a-98ad-33f358a61874-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (3b17de51-9249-4378-8f2f-ca640520dc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd95a44c-a902-4eb7-9329-d79bb33d889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd95a44c-a902-4eb7-9329-d79bb33d889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858491378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d6b935-01ab-4df3-8f1f-97af7e5090b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:39Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6516ec-860d-47e8-960f-53dbf1047c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6516ec-860d-47e8-960f-53dbf1047c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e1775a-1ea9-42f9-a42b-7a8a93d556b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77e1775a-1ea9-42f9-a42b-7a8a93d556b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d6b935-01ab-4df3-8f1f-97af7e5090b9', 'volume_name': 'volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad4e46-54ac-4b4d-aabb-dfc19736fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad4e46-54ac-4b4d-aabb-dfc19736fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf02c8-f5a0-4659-8131-d4ffc3bdccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Volume 74d6b935-01ab-4df3-8f1f-97af7e5090b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9', 'volume_size': 1} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858491378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d6b935-01ab-4df3-8f1f-97af7e5090b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:39Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Creating volume 74d6b935-01ab-4df3-8f1f-97af7e5090b9 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:39 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:39 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 1073741824 Jul 21 08:23:39 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:40 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 1073741824" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:40 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 Jul 21 08:23:40 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:40 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf02c8-f5a0-4659-8131-d4ffc3bdccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648e38b6-15d0-4aaf-8f4d-7aa23052edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Volume volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 (74d6b935-01ab-4df3-8f1f-97af7e5090b9): created successfully Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648e38b6-15d0-4aaf-8f4d-7aa23052edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (3b17de51-9249-4378-8f2f-ca640520dc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-74985cd1-6d9f-454c-b79d-5b124407b96d tempest-ProjectReaderTests-1735665201 None] Created volume successfully. Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-74d6b935-01ab-4df3-8f1f-97af7e5090b9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-74d6b935-01ab-4df3-8f1f-97af7e5090b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-quobyte-74d6b935-01ab-4df3-8f1f-97af7e5090b9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-74d6b935-01ab-4df3-8f1f-97af7e5090b9" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde5c63b-34da-4022-931b-866c1b3608d7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:40 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 Jul 21 08:23:40 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:41 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:41 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9 Jul 21 08:23:41 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:41 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-74d6b935-01ab-4df3-8f1f-97af7e5090b9" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-74d6b935-01ab-4df3-8f1f-97af7e5090b9" released by "delete_volume" :: held 0.720s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Created reservations ['925ad38c-227a-4892-a279-efd7e812182b', 'e7580a00-914d-4c31-9f71-2463c06c271c', '50343d37-1cb8-4774-bd95-e518a9cc47f4', 'ad8efb24-4b16-4f88-871b-ffc0e1af5ee8'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:41 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:41 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:41 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Deleted volume successfully. Jul 21 08:23:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ac8ba777-29ea-43f4-afeb-459030e294b9 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-74d6b935-01ab-4df3-8f1f-97af7e5090b9-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (9921d37c-e51d-466f-9b45-3c7ffb7d79c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea668fd4-0e8b-4174-9761-6637d03f1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea668fd4-0e8b-4174-9761-6637d03f1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012746698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b0c1ed-59b9-475c-9d9b-c2cd535c42de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:42Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25136155-3beb-4bb7-87e6-d66bae49f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25136155-3beb-4bb7-87e6-d66bae49f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f913ee-6d06-4541-b83d-1f6c28b692a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24f913ee-6d06-4541-b83d-1f6c28b692a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b0c1ed-59b9-475c-9d9b-c2cd535c42de', 'volume_name': 'volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b25d5a6-ac9f-4169-995f-b5aac29dd922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b25d5a6-ac9f-4169-995f-b5aac29dd922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec261121-7f4f-468f-a90f-74a33e6b53f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:42 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Volume 38b0c1ed-59b9-475c-9d9b-c2cd535c42de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de', 'volume_size': 1} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012746698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b0c1ed-59b9-475c-9d9b-c2cd535c42de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:42Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Creating volume 38b0c1ed-59b9-475c-9d9b-c2cd535c42de {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:42 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:42 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de 1073741824 Jul 21 08:23:42 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:42 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de 1073741824" returned: 0 in 0.458s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:42 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de Jul 21 08:23:42 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:43 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec261121-7f4f-468f-a90f-74a33e6b53f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc451be-284f-4f1a-8d34-6afadef638d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:43 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Volume volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de (38b0c1ed-59b9-475c-9d9b-c2cd535c42de): created successfully Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc451be-284f-4f1a-8d34-6afadef638d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (9921d37c-e51d-466f-9b45-3c7ffb7d79c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:43 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d792ba7e-3dc5-4817-8acf-22bc83109f1d tempest-ProjectReaderTests-1735665201 None] Created volume successfully. Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-38b0c1ed-59b9-475c-9d9b-c2cd535c42de-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "cinder-38b0c1ed-59b9-475c-9d9b-c2cd535c42de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-quobyte-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[95879b50-7f4c-43e2-b997-e6d16227661b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:43 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de Jul 21 08:23:43 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:43 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" returned: 0 in 0.460s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:43 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de Jul 21 08:23:43 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:44 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-38b0c1ed-59b9-475c-9d9b-c2cd535c42de" released by "delete_volume" :: held 0.764s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Created reservations ['f9971468-1d06-43da-bab4-033d72ff07a4', 'ec6bcfb8-4386-4b13-9f4c-e2c62e7734d1', '50ba971c-2040-4815-b805-8d8a425d47a2', 'f9445916-4989-4679-b454-da21c8252cff'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:44 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:44 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:44 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.247s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Deleted volume successfully. Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-283f4ec5-eca7-4eae-bcd1-34c5f4072b7f tempest-ProjectReaderTests-1735665201 None] Lock "cinder-38b0c1ed-59b9-475c-9d9b-c2cd535c42de-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:44 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (c24d5f63-e803-4d23-8371-9c53d9ce0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa44d68-5b87-484f-8041-1440fd6f69d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa44d68-5b87-484f-8041-1440fd6f69d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169877721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5785546-b1a7-4194-8526-5fa87de5f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:45Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95147161-d8ef-4827-bb34-054d73cae60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95147161-d8ef-4827-bb34-054d73cae60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85e8712-bcaa-472e-8b86-b7659805c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85e8712-bcaa-472e-8b86-b7659805c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5785546-b1a7-4194-8526-5fa87de5f73f', 'volume_name': 'volume-e5785546-b1a7-4194-8526-5fa87de5f73f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19447125-c03b-4db3-a345-f37f83ffdcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19447125-c03b-4db3-a345-f37f83ffdcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653abe9c-5996-4a27-be25-cac2526a192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Volume e5785546-b1a7-4194-8526-5fa87de5f73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5785546-b1a7-4194-8526-5fa87de5f73f', 'volume_size': 1} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169877721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5785546-b1a7-4194-8526-5fa87de5f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:45Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Creating volume e5785546-b1a7-4194-8526-5fa87de5f73f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:45 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:45 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f 1073741824 Jul 21 08:23:45 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:45 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f 1073741824" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:45 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f Jul 21 08:23:45 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:45 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653abe9c-5996-4a27-be25-cac2526a192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5785546-b1a7-4194-8526-5fa87de5f73f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00feee4-2027-440d-b9b4-50321d5e0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:45 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Volume volume-e5785546-b1a7-4194-8526-5fa87de5f73f (e5785546-b1a7-4194-8526-5fa87de5f73f): created successfully Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00feee4-2027-440d-b9b4-50321d5e0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (c24d5f63-e803-4d23-8371-9c53d9ce0f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-69854321-3ad4-45f1-a78f-8ff32e993807 tempest-ProjectReaderTests-1735665201 None] Created volume successfully. Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-e5785546-b1a7-4194-8526-5fa87de5f73f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-e5785546-b1a7-4194-8526-5fa87de5f73f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-quobyte-e5785546-b1a7-4194-8526-5fa87de5f73f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-e5785546-b1a7-4194-8526-5fa87de5f73f" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[811fc916-1384-4ba7-b7cc-2b83de5ccde3]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:46 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f Jul 21 08:23:46 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:46 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:46 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f Jul 21 08:23:46 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:46 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e5785546-b1a7-4194-8526-5fa87de5f73f" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-e5785546-b1a7-4194-8526-5fa87de5f73f" released by "delete_volume" :: held 0.677s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Created reservations ['e4666562-f573-4e60-bf4b-a14390b0c733', 'd1b6163a-2853-4a36-874d-6c017eff52a7', '08247656-5ced-44ab-b7e9-875e9d04d339', '9fdcf0d0-500d-455b-9a68-ae440bf9a79f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:46 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:46 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:47 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.284s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:47 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Deleted volume successfully. Jul 21 08:23:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ebd64f57-995e-4f88-a1de-43161b39c733 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-e5785546-b1a7-4194-8526-5fa87de5f73f-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (dbc45477-d398-4b67-8b2a-436d1ea2c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83ce2ca-4b7f-4b72-b696-7aea2ccce926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83ce2ca-4b7f-4b72-b696-7aea2ccce926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2050991762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823875f8-249b-4c79-a112-9097e9051b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63e131-db21-4e61-9c4d-fa5d0ef51817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f63e131-db21-4e61-9c4d-fa5d0ef51817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcc7d63-77cb-4568-8f92-b36def2f4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcc7d63-77cb-4568-8f92-b36def2f4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823875f8-249b-4c79-a112-9097e9051b7a', 'volume_name': 'volume-823875f8-249b-4c79-a112-9097e9051b7a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91e142d-6060-43c9-9612-db2c5831277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91e142d-6060-43c9-9612-db2c5831277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09451746-076e-4ff2-96f6-5f1a9c28b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Volume 823875f8-249b-4c79-a112-9097e9051b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823875f8-249b-4c79-a112-9097e9051b7a', 'volume_size': 1} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2050991762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823875f8-249b-4c79-a112-9097e9051b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa8bb38b2c54833a6b6a6aa1a5fe898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='2bdc5e7d59ab47c884dfad194e4d8d0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Creating volume 823875f8-249b-4c79-a112-9097e9051b7a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:48 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:48 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a 1073741824 Jul 21 08:23:48 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (91481f27-f8a2-4ed6-a737-d1336c3eb501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5286a4c-0603-4e73-930c-20cb4d6b972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5286a4c-0603-4e73-930c-20cb4d6b972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1798554624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833bd5b9-c773-451c-9c93-e3aec6c7ea1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56aa7443-5b91-4b4d-9411-ac7fd6f7f8cd),volume_type_id=56aa7443-5b91-4b4d-9411-ac7fd6f7f8cd)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c2513d-a8e1-420c-902e-3add7f0ef65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c2513d-a8e1-420c-902e-3add7f0ef65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57987a0d-6290-453d-8183-1982c33eb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57987a0d-6290-453d-8183-1982c33eb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833bd5b9-c773-451c-9c93-e3aec6c7ea1a', 'volume_name': 'volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feda896-bea7-495e-be1b-ff4baf3bb2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feda896-bea7-495e-be1b-ff4baf3bb2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72646940-7994-4121-942f-026d315dd6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume 833bd5b9-c773-451c-9c93-e3aec6c7ea1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a', 'volume_size': 1} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (fbbbd5ed-4b35-463a-b060-1a1715a95685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93cdd0a-5c0d-453e-b980-21e4ad9b75cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93cdd0a-5c0d-453e-b980-21e4ad9b75cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1498823399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(758a372a-9e62-4a38-8489-04a6c568211b),volume_type_id=758a372a-9e62-4a38-8489-04a6c568211b)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eac0c4-e19e-412d-9d39-a82c2d459e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eac0c4-e19e-412d-9d39-a82c2d459e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577af95-47de-4a54-8e25-11633b960557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8577af95-47de-4a54-8e25-11633b960557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1', 'volume_name': 'volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113133e-146e-4fab-a2f9-59757f3de57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d113133e-146e-4fab-a2f9-59757f3de57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40cfd19-f471-4683-a3c7-d94c105d2ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume 58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1', 'volume_size': 1} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:48 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a 1073741824" returned: 0 in 0.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:48 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a Jul 21 08:23:48 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (b27628ae-b177-4f2d-a8c0-124b8fe577fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c83b96-3342-40b4-a4d7-a268aa07620f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c83b96-3342-40b4-a4d7-a268aa07620f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-854161417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab38535-a5d3-4513-b09a-f0e05d50aca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:49Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b666f24d-6c41-4881-9208-a660050f0298),volume_type_id=b666f24d-6c41-4881-9208-a660050f0298)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e43008-3f8f-43f5-a9fd-0f7799bbbf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e43008-3f8f-43f5-a9fd-0f7799bbbf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a60f27-de87-4d26-84b7-79a130fa9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:23:48 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1798554624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833bd5b9-c773-451c-9c93-e3aec6c7ea1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56aa7443-5b91-4b4d-9411-ac7fd6f7f8cd),volume_type_id=56aa7443-5b91-4b4d-9411-ac7fd6f7f8cd)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Creating volume 833bd5b9-c773-451c-9c93-e3aec6c7ea1a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:48 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:49 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a 1073741824 Jul 21 08:23:49 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09451746-076e-4ff2-96f6-5f1a9c28b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823875f8-249b-4c79-a112-9097e9051b7a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa857cb7-80b8-4bbb-9dd3-f5a1598cd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Volume volume-823875f8-249b-4c79-a112-9097e9051b7a (823875f8-249b-4c79-a112-9097e9051b7a): created successfully Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa857cb7-80b8-4bbb-9dd3-f5a1598cd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Flow 'volume_create_manager' (dbc45477-d398-4b67-8b2a-436d1ea2c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-eb4a174c-11f9-497c-baf6-60531c9a4ffd tempest-ProjectReaderTests-1735665201 None] Created volume successfully. Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a60f27-de87-4d26-84b7-79a130fa9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fab38535-a5d3-4513-b09a-f0e05d50aca0', 'volume_name': 'volume-fab38535-a5d3-4513-b09a-f0e05d50aca0', 'volume_size': 1, 'image_id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255809753', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd4d573eb008409a82261316f218e26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'created_at': datetime.datetime(2026, 7, 21, 6, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 23, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b79c02c-6322-48a7-9e6a-c5aed676b736/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eaf652-f18a-4de5-bbcf-ac06a27868df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eaf652-f18a-4de5-bbcf-ac06a27868df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b3e76b-8e4c-4e6b-a8d2-1bacdc66df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume fab38535-a5d3-4513-b09a-f0e05d50aca0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fab38535-a5d3-4513-b09a-f0e05d50aca0', 'volume_size': 1, 'image_id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255809753', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd4d573eb008409a82261316f218e26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'created_at': datetime.datetime(2026, 7, 21, 6, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 23, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b79c02c-6322-48a7-9e6a-c5aed676b736/file', 'properties': {}}, 'image_service': } Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Trying to clone fab38535-a5d3-4513-b09a-f0e05d50aca0 from image 7b79c02c-6322-48a7-9e6a-c5aed676b736 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:23:49 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a 1073741824" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:49 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a Jul 21 08:23:49 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:49 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" returned: 0 in 0.253s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1498823399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:48Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(758a372a-9e62-4a38-8489-04a6c568211b),volume_type_id=758a372a-9e62-4a38-8489-04a6c568211b)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Creating volume 58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72646940-7994-4121-942f-026d315dd6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 1073741824 Jul 21 08:23:49 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4019696a-81e4-42b4-b027-2b23d0d18d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a (833bd5b9-c773-451c-9c93-e3aec6c7ea1a): created successfully Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4019696a-81e4-42b4-b027-2b23d0d18d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (91481f27-f8a2-4ed6-a737-d1336c3eb501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2b88b1f0-3616-4069-9c78-5f0e88d5c449 tempest-TestInstancesWithCinderVolumes-1866902612 None] Created volume successfully. Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-823875f8-249b-4c79-a112-9097e9051b7a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-823875f8-249b-4c79-a112-9097e9051b7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "cinder-quobyte-823875f8-249b-4c79-a112-9097e9051b7a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:23:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-823875f8-249b-4c79-a112-9097e9051b7a" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7e44c-9c53-4b91-8273-1e5fb0a22465]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:50 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a Jul 21 08:23:50 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:50 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 1073741824" returned: 0 in 0.517s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:50 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 Jul 21 08:23:50 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:50 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:50 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a Jul 21 08:23:50 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:50 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40cfd19-f471-4683-a3c7-d94c105d2ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a1f69-1cb2-4989-976e-b4413598ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:50 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 (58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1): created successfully Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a1f69-1cb2-4989-976e-b4413598ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (fbbbd5ed-4b35-463a-b060-1a1715a95685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0eeaedae-7ae2-4643-bc5b-134391e18277 tempest-TestInstancesWithCinderVolumes-1866902612 None] Created volume successfully. Jul 21 08:23:50 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-823875f8-249b-4c79-a112-9097e9051b7a" returned: 0 in 0.270s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-quobyte-823875f8-249b-4c79-a112-9097e9051b7a" released by "delete_volume" :: held 0.712s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Created reservations ['d3915359-0340-4c1e-a8fa-87112a9ab616', '486870c8-a151-4d54-8baa-818291c9bfa1', '139d5650-449d-45cb-b369-45dd022f9ae7', '3ad04421-cba2-4989-93b7-9aa87f899f7c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:50 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:50 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:51 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.277s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:51 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:51 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Deleted volume successfully. Jul 21 08:23:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-80a0c3ab-3bf6-4bf5-85b6-8cbfd1067ef0 tempest-ProjectReaderTests-1735665201 None] Lock "cinder-823875f8-249b-4c79-a112-9097e9051b7a-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:52 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:23:52 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD, size 20.69 MB, duration 3.75 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:23:52 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Image download 20.69 MB at 5.52 MB/s Jul 21 08:23:52 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbdfea3-a7aa-4d94-9b84-cf8bae74b356]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:53 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD Jul 21 08:23:53 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:53 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Temporary image 7b79c02c-6322-48a7-9e6a-c5aed676b736 is fetched for user d62499bb64494d82861d6ca4479ac773. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8380a2-6061-4449-a79c-8255238acc67]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:53 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD Jul 21 08:23:53 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:53 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-854161417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab38535-a5d3-4513-b09a-f0e05d50aca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4d573eb008409a82261316f218e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:23:49Z,use_quota=True,user_id='d62499bb64494d82861d6ca4479ac773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b666f24d-6c41-4881-9208-a660050f0298),volume_type_id=b666f24d-6c41-4881-9208-a660050f0298)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Creating volume fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:23:53 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:23:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:53 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1073741824 Jul 21 08:23:53 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:54 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1073741824" returned: 0 in 0.407s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:54 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 Jul 21 08:23:54 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:54 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0" returned: 0 in 0.233s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Attempting download of 7b79c02c-6322-48a7-9e6a-c5aed676b736 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}])) to volume fab38535-a5d3-4513-b09a-f0e05d50aca0. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df9e77-b452-4836-9a86-9091d8631abb]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:54 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg Jul 21 08:23:54 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:54 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg" returned: 0 in 0.320s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:54 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg Jul 21 08:23:54 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:55 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg" returned: 1 in 0.319s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b79c02c-6322-48a7-9e6a-c5aed676b736_9to9iorg' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001e41e-d818-4f4d-883e-d6b88aee194f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:55 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD Jul 21 08:23:55 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:55 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] 7b79c02c-6322-48a7-9e6a-c5aed676b736 was qcow2, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:23:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:55 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 Jul 21 08:23:55 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:56 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0" returned: 0 in 1.545s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:56 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b79c02c-6322-48a7-9e6a-c5aed676b736_thhy62v5devstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:23:56 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Converted 112.00 MB image at 72.42 MB/s Jul 21 08:23:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:23:56 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1G Jul 21 08:23:56 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:23:57 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 1G" returned: 0 in 0.309s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Downloaded image 7b79c02c-6322-48a7-9e6a-c5aed676b736 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}])) to volume fab38535-a5d3-4513-b09a-f0e05d50aca0 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Temporary image 7b79c02c-6322-48a7-9e6a-c5aed676b736 for user d62499bb64494d82861d6ca4479ac773 is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Marking volume fab38535-a5d3-4513-b09a-f0e05d50aca0 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Copying metadata from image 7b79c02c-6322-48a7-9e6a-c5aed676b736 to fab38535-a5d3-4513-b09a-f0e05d50aca0. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Creating volume glance metadata for volume fab38535-a5d3-4513-b09a-f0e05d50aca0 backed by image 7b79c02c-6322-48a7-9e6a-c5aed676b736 with: {'image_id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'image_name': 'tempest-scenario-img--1255809753', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b3e76b-8e4c-4e6b-a8d2-1bacdc66df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab38535-a5d3-4513-b09a-f0e05d50aca0', 'volume_size': 1, 'image_id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b79c02c-6322-48a7-9e6a-c5aed676b736', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1255809753', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cd4d573eb008409a82261316f218e26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b79c02c-6322-48a7-9e6a-c5aed676b736', 'created_at': datetime.datetime(2026, 7, 21, 6, 23, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 23, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b79c02c-6322-48a7-9e6a-c5aed676b736/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4021660-9359-405d-8531-61faf102f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:23:57 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Volume volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 (fab38535-a5d3-4513-b09a-f0e05d50aca0): created successfully Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4021660-9359-405d-8531-61faf102f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:23:57 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Flow 'volume_create_manager' (b27628ae-b177-4f2d-a8c0-124b8fe577fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:23:57 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0cd052f9-0818-425f-acdf-9689fd59fb60 tempest-TestInstancesWithCinderVolumes-1866902612 None] Created volume successfully. Jul 21 08:24:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a1bf6b4f-7c3c-4d39-8ce1-3a632013c5ab req-7f76b9b2-798b-450b-984c-56ff3f6d36ff tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a1bf6b4f-7c3c-4d39-8ce1-3a632013c5ab req-7f76b9b2-798b-450b-984c-56ff3f6d36ff tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-a1bf6b4f-7c3c-4d39-8ce1-3a632013c5ab req-7f76b9b2-798b-450b-984c-56ff3f6d36ff tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-a1bf6b4f-7c3c-4d39-8ce1-3a632013c5ab req-7f76b9b2-798b-450b-984c-56ff3f6d36ff tempest-TestInstancesWithCinderVolumes-1866902612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-fab38535-a5d3-4513-b09a-f0e05d50aca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '185da043-33d1-4cf9-a7cf-8556d850e2ea', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:24:00 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a1bf6b4f-7c3c-4d39-8ce1-3a632013c5ab req-7f76b9b2-798b-450b-984c-56ff3f6d36ff tempest-TestInstancesWithCinderVolumes-1866902612 None] attachment_update completed successfully. Jul 21 08:24:10 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=134,cinder:SELECT=89,cinder:INSERT=36,cinder:DELETE=7 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:24:10 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=97,cinder:UPDATE=126,cinder:DELETE=17,cinder:INSERT=30 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:24:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-ef281ef3-1b45-4378-bad6-07aad8b96e4a req-72733964-b303-4edd-a70b-3c7ced04d6e7 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-ef281ef3-1b45-4378-bad6-07aad8b96e4a req-72733964-b303-4edd-a70b-3c7ced04d6e7 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-ef281ef3-1b45-4378-bad6-07aad8b96e4a req-72733964-b303-4edd-a70b-3c7ced04d6e7 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-ef281ef3-1b45-4378-bad6-07aad8b96e4a req-72733964-b303-4edd-a70b-3c7ced04d6e7 tempest-TestInstancesWithCinderVolumes-1866902612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23039506-64bf-4693-8fd4-5f00595f8ebb', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:24:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-ef281ef3-1b45-4378-bad6-07aad8b96e4a req-72733964-b303-4edd-a70b-3c7ced04d6e7 tempest-TestInstancesWithCinderVolumes-1866902612 None] attachment_update completed successfully. Jul 21 08:24:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-cf6083ab-5e00-4a65-8e8d-fe7b1bc75d48 req-67b0074a-1070-4330-9f5a-5aeebb7c5885 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-cf6083ab-5e00-4a65-8e8d-fe7b1bc75d48 req-67b0074a-1070-4330-9f5a-5aeebb7c5885 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-cf6083ab-5e00-4a65-8e8d-fe7b1bc75d48 req-67b0074a-1070-4330-9f5a-5aeebb7c5885 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-cf6083ab-5e00-4a65-8e8d-fe7b1bc75d48 req-67b0074a-1070-4330-9f5a-5aeebb7c5885 tempest-TestInstancesWithCinderVolumes-1866902612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00850518-c425-4fd1-aea9-650ad11d7c8e', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:24:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-cf6083ab-5e00-4a65-8e8d-fe7b1bc75d48 req-67b0074a-1070-4330-9f5a-5aeebb7c5885 tempest-TestInstancesWithCinderVolumes-1866902612 None] attachment_update completed successfully. Jul 21 08:24:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-bf263493-0866-4f92-8013-270356a96a6a req-19149ecd-e54b-4459-8347-bc596dce7a77 tempest-TestInstancesWithCinderVolumes-1866902612 None] Terminate volume connection completed successfully. Jul 21 08:24:37 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-bf263493-0866-4f92-8013-270356a96a6a req-19149ecd-e54b-4459-8347-bc596dce7a77 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleting attachment 23039506-64bf-4693-8fd4-5f00595f8ebb. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-833bd5b9-c773-451c-9c93-e3aec6c7ea1a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-833bd5b9-c773-451c-9c93-e3aec6c7ea1a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-quobyte-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8f6b1-b869-48fa-94bd-0c9d97ba9272]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:24:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:38 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a Jul 21 08:24:38 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:39 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" returned: 0 in 0.387s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:39 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a Jul 21 08:24:39 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:39 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" returned: 0 in 0.257s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-833bd5b9-c773-451c-9c93-e3aec6c7ea1a" released by "delete_volume" :: held 0.687s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:39 devstack cinder-volume[87372]: WARNING cinder.quota [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1941770877-1907781888 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1941770877-1907781888, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:39 devstack cinder-volume[87372]: WARNING cinder.quota [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1941770877-1907781888 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1941770877-1907781888, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Created reservations ['d21e4a72-5354-40e0-b9c9-bf7fe0356a8d', '0485cc5f-6910-43eb-b680-99d98efe0f9f', 'b20a4e2f-2c58-4002-b262-e6723e48de98', 'fc590116-4c72-485c-858e-343ab02dc715'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:39 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:24:39 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:39 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.283s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:24:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleted volume successfully. Jul 21 08:24:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-51912609-6d56-41ad-a18b-53040f53929a tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-833bd5b9-c773-451c-9c93-e3aec6c7ea1a-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:41 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-9b93c661-feef-482c-aa47-deb5e81fb3a4 req-b8bf20d7-11ef-4f74-b243-dd6b40f31d36 tempest-TestInstancesWithCinderVolumes-1866902612 None] Terminate volume connection completed successfully. Jul 21 08:24:41 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-9b93c661-feef-482c-aa47-deb5e81fb3a4 req-b8bf20d7-11ef-4f74-b243-dd6b40f31d36 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleting attachment 00850518-c425-4fd1-aea9-650ad11d7c8e. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-quobyte-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" acquired by "delete_volume" :: waited 0.012s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9637d3-9e16-468e-8e66-0c4352d38925]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:24:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:43 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 Jul 21 08:24:43 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:43 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:43 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1 Jul 21 08:24:43 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:43 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1" released by "delete_volume" :: held 0.683s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:43 devstack cinder-volume[87372]: WARNING cinder.quota [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649066960-2073272543 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649066960-2073272543, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:43 devstack cinder-volume[87372]: WARNING cinder.quota [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649066960-2073272543 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649066960-2073272543, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Created reservations ['32875b3f-7f5a-4a9f-81ac-f32944081b8c', '7001c429-b93a-4af7-adc9-804bdbcb6c53', '214505aa-90f2-4653-95fc-152f25af7cab', '59247cfc-a39a-4104-8505-9b2737221b43'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:43 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:24:43 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:44 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:44 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:24:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleted volume successfully. Jul 21 08:24:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64869dfc-26f6-4487-9e14-ec5eae6f45ca tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-58b4bae3-1b14-4573-b8f8-ccf99dfc0cf1-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:46 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-6bc30211-45a2-4d54-9e4b-097bb863d2fb req-1a94d5f6-3cc9-4c73-9b1b-84214af78e70 tempest-TestInstancesWithCinderVolumes-1866902612 None] Terminate volume connection completed successfully. Jul 21 08:24:46 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-6bc30211-45a2-4d54-9e4b-097bb863d2fb req-1a94d5f6-3cc9-4c73-9b1b-84214af78e70 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleting attachment 185da043-33d1-4cf9-a7cf-8556d850e2ea. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-fab38535-a5d3-4513-b09a-f0e05d50aca0-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-fab38535-a5d3-4513-b09a-f0e05d50aca0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "cinder-quobyte-fab38535-a5d3-4513-b09a-f0e05d50aca0" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-fab38535-a5d3-4513-b09a-f0e05d50aca0" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39c1a7-a6fe-43ff-8424-37e234964de5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:47 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 Jul 21 08:24:47 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:47 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:47 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0 Jul 21 08:24:47 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:48 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fab38535-a5d3-4513-b09a-f0e05d50aca0" returned: 0 in 0.242s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-quobyte-fab38535-a5d3-4513-b09a-f0e05d50aca0" released by "delete_volume" :: held 0.631s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:48 devstack cinder-volume[87372]: WARNING cinder.quota [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255785532-99130592 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255785532-99130592, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:48 devstack cinder-volume[87372]: WARNING cinder.quota [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255785532-99130592 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1255785532-99130592, it is now deprecated. Please use the default quota class for default quota. Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Created reservations ['84f6f3b6-a862-46eb-9772-d91454cfbf22', '9366ee5c-43db-43c6-837b-9dade4a237fa', '80d14fe5-923f-46d0-8ca6-0fcf2a8bbb48', 'fbf7c892-26ed-4f81-b27b-765f58cd95a5'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:48 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:24:48 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:48 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.239s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:24:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Deleted volume successfully. Jul 21 08:24:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1a431e02-ea3d-48b8-941c-904579e7f2d3 tempest-TestInstancesWithCinderVolumes-1866902612 None] Lock "cinder-fab38535-a5d3-4513-b09a-f0e05d50aca0-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:24:52 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:24:52 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:24:52 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:24:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:24:58 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=33,cinder:UPDATE=29,cinder:INSERT=8 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:24:58 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=26,cinder:SELECT=30,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Flow 'volume_create_manager' (af0f16dd-b4e9-4ca6-9065-1e9718c544f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124b5af4-c7f2-4186-8e9d-04a5186561dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124b5af4-c7f2-4186-8e9d-04a5186561dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-285388173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7d63d3-6a61-48bb-87c8-956200cbd2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d44fd2589437aaacdfb5ab34835ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:25:18Z,use_quota=True,user_id='b4019de900684ffe88e464ba82ffa0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c603231-06c0-4bb8-9b0b-c155e8789797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c603231-06c0-4bb8-9b0b-c155e8789797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106ca984-31da-4083-b4ed-617d6f3c0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106ca984-31da-4083-b4ed-617d6f3c0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7d63d3-6a61-48bb-87c8-956200cbd2ec', 'volume_name': 'volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4631e0d-bd99-4bed-80ac-18a3d574912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4631e0d-bd99-4bed-80ac-18a3d574912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d733243-9c7a-4e1a-99a0-aa0c52353239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume ca7d63d3-6a61-48bb-87c8-956200cbd2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec', 'volume_size': 1} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-285388173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7d63d3-6a61-48bb-87c8-956200cbd2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d44fd2589437aaacdfb5ab34835ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:25:18Z,use_quota=True,user_id='b4019de900684ffe88e464ba82ffa0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Creating volume ca7d63d3-6a61-48bb-87c8-956200cbd2ec {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:25:17 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:25:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:17 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec 1073741824 Jul 21 08:25:17 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Flow 'volume_create_manager' (33f2b4da-18b4-4373-ae37-5016c07560b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04ae0fe-55ca-4f72-ba27-b60df6d11928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04ae0fe-55ca-4f72-ba27-b60df6d11928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-312135841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48db4f08-eb75-4c31-a264-8b58848b5c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d44fd2589437aaacdfb5ab34835ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:25:18Z,use_quota=True,user_id='b4019de900684ffe88e464ba82ffa0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d767f40-dd20-4331-b684-931dea77d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d767f40-dd20-4331-b684-931dea77d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640f716b-61ff-4732-986b-5c9ebcddef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640f716b-61ff-4732-986b-5c9ebcddef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48db4f08-eb75-4c31-a264-8b58848b5c3a', 'volume_name': 'volume-48db4f08-eb75-4c31-a264-8b58848b5c3a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44edaf3-d979-451e-b946-0675e86b110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44edaf3-d979-451e-b946-0675e86b110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0cbb9d-cc8c-47e4-8e3b-9a81ecd72fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume 48db4f08-eb75-4c31-a264-8b58848b5c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48db4f08-eb75-4c31-a264-8b58848b5c3a', 'volume_size': 1} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:18 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec 1073741824" returned: 0 in 0.514s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:18 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec Jul 21 08:25:18 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:18 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-312135841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48db4f08-eb75-4c31-a264-8b58848b5c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9d44fd2589437aaacdfb5ab34835ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:25:18Z,use_quota=True,user_id='b4019de900684ffe88e464ba82ffa0e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Creating volume 48db4f08-eb75-4c31-a264-8b58848b5c3a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:25:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d733243-9c7a-4e1a-99a0-aa0c52353239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a 1073741824 Jul 21 08:25:18 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11a079a-a7f5-4535-8ebb-24d34010c7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:18 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec (ca7d63d3-6a61-48bb-87c8-956200cbd2ec): created successfully Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11a079a-a7f5-4535-8ebb-24d34010c7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:18 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Flow 'volume_create_manager' (af0f16dd-b4e9-4ca6-9065-1e9718c544f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:25:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-389c29d2-7b04-4b33-a8bc-8392ef4cdad4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Created volume successfully. Jul 21 08:25:19 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a 1073741824" returned: 0 in 0.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:19 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a Jul 21 08:25:19 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:19 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a" returned: 0 in 0.251s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0cbb9d-cc8c-47e4-8e3b-9a81ecd72fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48db4f08-eb75-4c31-a264-8b58848b5c3a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d99026-cd0e-451d-9a05-e88729b3e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:25:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Volume volume-48db4f08-eb75-4c31-a264-8b58848b5c3a (48db4f08-eb75-4c31-a264-8b58848b5c3a): created successfully Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d99026-cd0e-451d-9a05-e88729b3e623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:25:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Flow 'volume_create_manager' (33f2b4da-18b4-4373-ae37-5016c07560b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:25:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0948f706-dc48-402f-aece-6cf10c636c79 tempest-TestServerVolumeAttachmentScenario-988762836 None] Created volume successfully. Jul 21 08:25:29 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:25:29 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:25:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3921731f-e74a-4a88-bea3-776662e74274 req-79ab9a33-3a53-4f58-8a2a-c3cfe3d8cae4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3921731f-e74a-4a88-bea3-776662e74274 req-79ab9a33-3a53-4f58-8a2a-c3cfe3d8cae4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-3921731f-e74a-4a88-bea3-776662e74274 req-79ab9a33-3a53-4f58-8a2a-c3cfe3d8cae4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:48 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-3921731f-e74a-4a88-bea3-776662e74274 req-79ab9a33-3a53-4f58-8a2a-c3cfe3d8cae4 tempest-TestServerVolumeAttachmentScenario-988762836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52230ad7-60e5-4b3b-bb61-35ce14462d73', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:25:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-3921731f-e74a-4a88-bea3-776662e74274 req-79ab9a33-3a53-4f58-8a2a-c3cfe3d8cae4 tempest-TestServerVolumeAttachmentScenario-988762836 None] attachment_update completed successfully. Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-e4644009-5647-4867-bd20-6565c2a0fd71 req-5136c72b-3cad-4b62-af49-9d110aaa3440 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-e4644009-5647-4867-bd20-6565c2a0fd71 req-5136c72b-3cad-4b62-af49-9d110aaa3440 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [req-e4644009-5647-4867-bd20-6565c2a0fd71 req-5136c72b-3cad-4b62-af49-9d110aaa3440 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-e4644009-5647-4867-bd20-6565c2a0fd71 req-5136c72b-3cad-4b62-af49-9d110aaa3440 tempest-TestServerVolumeAttachmentScenario-988762836 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06', 'name': 'volume-48db4f08-eb75-4c31-a264-8b58848b5c3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27e35719-c201-4b5d-86a9-b1f4b5c239a1', 'enforce_multipath': True} {{(pid=87372) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 21 08:25:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-e4644009-5647-4867-bd20-6565c2a0fd71 req-5136c72b-3cad-4b62-af49-9d110aaa3440 tempest-TestServerVolumeAttachmentScenario-988762836 None] attachment_update completed successfully. Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:52 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:25:52 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:52 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:25:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:25:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-a3806fe8-a7a5-436a-a3a2-8aec6ec31f62 req-19c0c714-22ae-4fe0-9368-2f34523ca671 tempest-TestServerVolumeAttachmentScenario-988762836 None] Terminate volume connection completed successfully. Jul 21 08:25:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-a3806fe8-a7a5-436a-a3a2-8aec6ec31f62 req-19c0c714-22ae-4fe0-9368-2f34523ca671 tempest-TestServerVolumeAttachmentScenario-988762836 None] Deleting attachment 27e35719-c201-4b5d-86a9-b1f4b5c239a1. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:25:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [req-7e450cb9-d813-45fd-a79b-b5d2fdd6079b req-5598f32e-9718-4c93-95ff-8db87a595aa5 tempest-TestServerVolumeAttachmentScenario-988762836 None] Terminate volume connection completed successfully. Jul 21 08:25:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [req-7e450cb9-d813-45fd-a79b-b5d2fdd6079b req-5598f32e-9718-4c93-95ff-8db87a595aa5 tempest-TestServerVolumeAttachmentScenario-988762836 None] Deleting attachment 52230ad7-60e5-4b3b-bb61-35ce14462d73. {{(pid=87372) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "cinder-48db4f08-eb75-4c31-a264-8b58848b5c3a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-48db4f08-eb75-4c31-a264-8b58848b5c3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "cinder-quobyte-48db4f08-eb75-4c31-a264-8b58848b5c3a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-quobyte-48db4f08-eb75-4c31-a264-8b58848b5c3a" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ed5b60-c307-40a3-87dd-7ad696fbfc25]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:59 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a Jul 21 08:25:59 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:59 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a" returned: 0 in 0.363s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:25:59 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a Jul 21 08:25:59 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:25:59 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-48db4f08-eb75-4c31-a264-8b58848b5c3a" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:25:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-quobyte-48db4f08-eb75-4c31-a264-8b58848b5c3a" released by "delete_volume" :: held 0.649s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Created reservations ['9ab1f092-39e8-46e1-925a-3b1813f47191', '4a88ddfc-9a56-4c53-ae32-699dd86e489e', '8b2e5bc9-ecf6-4d1f-81ac-4135b7f7dcea', '4a2b2a13-2efd-47bf-9b42-ff38b5b0c4f6'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:00 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:26:00 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:00 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:26:00 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Deleted volume successfully. Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-32c29cb4-74da-4e55-a41c-49163a520ec8 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-48db4f08-eb75-4c31-a264-8b58848b5c3a-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "cinder-ca7d63d3-6a61-48bb-87c8-956200cbd2ec-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-ca7d63d3-6a61-48bb-87c8-956200cbd2ec-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "cinder-quobyte-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-quobyte-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[30701815-c696-4998-81d7-38522874104c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:00 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec Jul 21 08:26:00 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:00 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:00 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec Jul 21 08:26:00 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:01 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" returned: 0 in 0.236s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-quobyte-ca7d63d3-6a61-48bb-87c8-956200cbd2ec" released by "delete_volume" :: held 0.625s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Created reservations ['29b6ca3a-574f-4cf4-8fed-28fba2b8f9c0', '6e04eb55-074a-4a16-87e8-672fda42325a', 'f8ecb1b0-9745-475d-9b39-488ef7091a83', 'ca2615e6-d096-4421-a504-ab6c1af0ab4c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:01 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:26:01 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:01 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.238s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:26:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Deleted volume successfully. Jul 21 08:26:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08c68071-1bdd-4b78-b478-5c3ccd6de532 tempest-TestServerVolumeAttachmentScenario-988762836 None] Lock "cinder-ca7d63d3-6a61-48bb-87c8-956200cbd2ec-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:11 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:26:11 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Flow 'volume_create_manager' (8b4090be-dca4-470d-9e62-21f7f45964c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645f87d-02c9-4b82-ac78-1a84be8a07a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3645f87d-02c9-4b82-ac78-1a84be8a07a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1465783247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0871ff64-c99f-4dba-bf1e-b397efc2aaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c0a832ac24a0d9ff25f197f047b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:26:34Z,use_quota=True,user_id='adc7dacb297541d3a7cd3cd9432e0e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b52b8-4338-4ed8-b9fa-b5eafd1bda5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b52b8-4338-4ed8-b9fa-b5eafd1bda5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c717cb4-46c0-4512-90e9-2c0e0fd0c0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c717cb4-46c0-4512-90e9-2c0e0fd0c0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0871ff64-c99f-4dba-bf1e-b397efc2aaaa', 'volume_name': 'volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac7e951-6971-4a70-b96a-6d04e22044d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac7e951-6971-4a70-b96a-6d04e22044d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19f06a-0b13-49f4-8c34-efe77eb0d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Volume 0871ff64-c99f-4dba-bf1e-b397efc2aaaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa', 'volume_size': 1} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1465783247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0871ff64-c99f-4dba-bf1e-b397efc2aaaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c0a832ac24a0d9ff25f197f047b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:26:34Z,use_quota=True,user_id='adc7dacb297541d3a7cd3cd9432e0e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Creating volume 0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:26:34 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:26:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:34 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa 1073741824 Jul 21 08:26:34 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:34 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa 1073741824" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:35 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:35 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:35 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea19f06a-0b13-49f4-8c34-efe77eb0d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2154c585-54ae-4f46-b77d-1e9398fc0e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Volume volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa (0871ff64-c99f-4dba-bf1e-b397efc2aaaa): created successfully Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2154c585-54ae-4f46-b77d-1e9398fc0e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Flow 'volume_create_manager' (8b4090be-dca4-470d-9e62-21f7f45964c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:26:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-76df1f1d-0958-4625-887b-378270c6c673 tempest-SnapshotDependencyTests-41716641 None] Created volume successfully. Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Creating offline snapshot 28db8a83-8fc6-4095-aa49-88748e91a043 of volume 0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f98d54-fa96-4e14-b44a-7f2853cef839]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:35 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:35 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:36 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.344s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:36 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 1G Jul 21 08:26:36 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:36 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 1G" returned: 0 in 0.374s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:36 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:36 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:36 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:36 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 is being set with open permissions: ugo+rw Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:36 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:36 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:36 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.238s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:37 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info Jul 21 08:26:37 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:37 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:37 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info is being set with open permissions: ugo+rw Jul 21 08:26:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:37 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info Jul 21 08:26:37 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:37 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.info" returned: 0 in 0.243s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-93314cc4-aced-49db-b948-4d1511651286 tempest-SnapshotDependencyTests-41716641 None] Create snapshot completed successfully Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Flow 'volume_create_manager' (dd115e22-cd74-44a9-a313-0499abd4d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91323e8-0527-4f7d-b430-f7227d25b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91323e8-0527-4f7d-b430-f7227d25b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a288feb-390d-4044-9149-7c0cef7d7d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c0a832ac24a0d9ff25f197f047b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28db8a83-8fc6-4095-aa49-88748e91a043,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:26:38Z,use_quota=True,user_id='adc7dacb297541d3a7cd3cd9432e0e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a23511-7aba-4879-a0e5-a4674f7dfd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a23511-7aba-4879-a0e5-a4674f7dfd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45bc06-7b9b-460e-8005-f082a88e6e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45bc06-7b9b-460e-8005-f082a88e6e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a288feb-390d-4044-9149-7c0cef7d7d99', 'volume_name': 'volume-6a288feb-390d-4044-9149-7c0cef7d7d99', 'volume_size': 1, 'snapshot_id': '28db8a83-8fc6-4095-aa49-88748e91a043'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6754c114-19e4-4f04-bec7-02f03b20fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6754c114-19e4-4f04-bec7-02f03b20fc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4f97bf-98a2-44aa-8c78-6417f6ab34ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:38 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Volume 6a288feb-390d-4044-9149-7c0cef7d7d99: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a288feb-390d-4044-9149-7c0cef7d7d99', 'volume_size': 1, 'snapshot_id': '28db8a83-8fc6-4095-aa49-88748e91a043'} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043-6a288feb-390d-4044-9149-7c0cef7d7d99" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043-6a288feb-390d-4044-9149-7c0cef7d7d99" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Creating volume 6a288feb-390d-4044-9149-7c0cef7d7d99 from snapshot 28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] snapshot: 28db8a83-8fc6-4095-aa49-88748e91a043, volume: 6a288feb-390d-4044-9149-7c0cef7d7d99, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[339bcfe0-d4b0-4ee1-8c69-d0bf3feb633f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:38 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:38 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:38 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.344s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424c611-79d4-439e-908e-cc7dad992541]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:38 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:38 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:39 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.349s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:39 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:26:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:39 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 Jul 21 08:26:39 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:43 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99" returned: 0 in 4.074s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bc5bb-9906-4d1e-a91c-168b1d6cf938]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:43 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:43 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:43 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.532s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:26:43 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Converted 1024.00 MB image at 251.25 MB/s Jul 21 08:26:43 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 is being set with open permissions: ugo+rw Jul 21 08:26:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:43 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 Jul 21 08:26:43 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:44 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99" returned: 0 in 0.240s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" released by "_copy_volume_from_snapshot" :: held 5.618s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043-6a288feb-390d-4044-9149-7c0cef7d7d99" released by "_create_volume_from_snapshot" :: held 5.646s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.660s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4f97bf-98a2-44aa-8c78-6417f6ab34ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a288feb-390d-4044-9149-7c0cef7d7d99', 'volume_size': 1, 'snapshot_id': '28db8a83-8fc6-4095-aa49-88748e91a043'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc8e2a-65cf-4c85-a0dd-e43d6fe69882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:26:44 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Volume volume-6a288feb-390d-4044-9149-7c0cef7d7d99 (6a288feb-390d-4044-9149-7c0cef7d7d99): created successfully Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc8e2a-65cf-4c85-a0dd-e43d6fe69882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Flow 'volume_create_manager' (dd115e22-cd74-44a9-a313-0499abd4d53b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:26:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-8652cf6c-0404-4fd3-8081-73e280661944 tempest-SnapshotDependencyTests-41716641 None] Created volume successfully. Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-28db8a83-8fc6-4095-aa49-88748e91a043-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-28db8a83-8fc6-4095-aa49-88748e91a043-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Deleting offline snapshot 28db8a83-8fc6-4095-aa49-88748e91a043 of volume 0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] snapshot_file for this snap is: volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8ebd0-3b37-4f37-b476-8862f99bfaa9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:45 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:45 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:45 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.341s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eda545-c71a-487e-86fb-256a131b6df8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:45 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:45 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:45 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.347s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:45 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:45 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:45 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:46 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043 Jul 21 08:26:46 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:46 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa.28db8a83-8fc6-4095-aa49-88748e91a043" returned: 0 in 0.239s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-28db8a83-8fc6-4095-aa49-88748e91a043" released by "_delete_snapshot" :: held 1.331s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" released by "delete_snapshot" :: held 1.355s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:46 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Created reservations ['1b799024-4ff7-4d3c-8dc3-2d08fcba5e19', '2125026f-9db1-4fc2-97e1-599d74fa8fcf', '5b6061ef-2f6e-414f-b0a7-db293f686116', '0a211394-d4fd-496b-bb01-38e816a0a711'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:26:46 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Delete snapshot completed successfully. Jul 21 08:26:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d7609549-4cb9-41de-a618-93f8cf5a21fb tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-28db8a83-8fc6-4095-aa49-88748e91a043-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-0871ff64-c99f-4dba-bf1e-b397efc2aaaa-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-0871ff64-c99f-4dba-bf1e-b397efc2aaaa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[315eabd1-22d9-4bbd-a2b5-0612aff94a46]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:47 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:47 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:47 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.348s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:47 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa Jul 21 08:26:47 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:47 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-0871ff64-c99f-4dba-bf1e-b397efc2aaaa" released by "delete_volume" :: held 0.659s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Created reservations ['3bf8312d-3aae-44e2-817c-d0851dc9d795', 'f0f4d04e-e58f-4708-af20-ada7a85e7d4e', '0e29e911-87a7-4652-8036-3ed99d22ac31', '2b9e3870-f10b-4566-a7e9-9a4afcd0dddd'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:47 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:26:47 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:48 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.251s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:26:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Deleted volume successfully. Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5e19497a-ba32-4ef5-8065-b0b2eabb3e23 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-0871ff64-c99f-4dba-bf1e-b397efc2aaaa-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-6a288feb-390d-4044-9149-7c0cef7d7d99-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-6a288feb-390d-4044-9149-7c0cef7d7d99-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[25656632-a489-470b-b93b-ec08dbb59d0d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:48 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 Jul 21 08:26:48 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:48 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99" returned: 0 in 0.350s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:48 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99 Jul 21 08:26:48 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:48 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6a288feb-390d-4044-9149-7c0cef7d7d99" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-quobyte-6a288feb-390d-4044-9149-7c0cef7d7d99" released by "delete_volume" :: held 0.638s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Created reservations ['13431453-dfaf-47c8-ab45-176fda2cbd51', 'cf8a79d5-589b-414d-9ac4-23e647ba5706', '1d6f4b8f-be74-446c-951e-ae5a0e0eb4f0', '7f5bab18-e3e3-464d-b038-508b441ca651'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:48 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:26:48 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:49 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.229s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:49 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:26:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Deleted volume successfully. Jul 21 08:26:49 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a5854815-dd79-4ca2-ae9b-6a01ad400825 tempest-SnapshotDependencyTests-41716641 None] Lock "cinder-6a288feb-390d-4044-9149-7c0cef7d7d99-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:26:52 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:26:52 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:26:52 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:26:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:26:58 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=29,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:26:59 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=19,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (461731fd-0dbd-4116-83c3-9a07c32d51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc370967-fa59-4c6b-a78b-5f74bc7f2303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc370967-fa59-4c6b-a78b-5f74bc7f2303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278748403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f9530a-674a-4de0-9e06-b40b3e9b2aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f68a07-f9d8-4f46-a97c-a6d1dafbd34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f68a07-f9d8-4f46-a97c-a6d1dafbd34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43135bc2-dfb1-4c97-8ed2-cfb9482fc67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43135bc2-dfb1-4c97-8ed2-cfb9482fc67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f9530a-674a-4de0-9e06-b40b3e9b2aae', 'volume_name': 'volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30363faf-1857-475b-bc50-2731443e9c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30363faf-1857-475b-bc50-2731443e9c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48e4bd7-1e5d-4fba-99b6-c5010bc354b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume d6f9530a-674a-4de0-9e06-b40b3e9b2aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae', 'volume_size': 1} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278748403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f9530a-674a-4de0-9e06-b40b3e9b2aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume d6f9530a-674a-4de0-9e06-b40b3e9b2aae {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:07 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:07 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae 1073741824 Jul 21 08:27:07 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e2250d93-19d9-44ad-ab39-db06bdbc1ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc436e4-7165-4356-a650-45ae80d5ad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc436e4-7165-4356-a650-45ae80d5ad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-127773271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd034a04-05aa-4592-b693-14942e197db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9686b9f8-2033-47f6-b943-9b65e19e762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9686b9f8-2033-47f6-b943-9b65e19e762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa31f7-33b0-499a-8c0c-c444fe48deff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8afa31f7-33b0-499a-8c0c-c444fe48deff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd034a04-05aa-4592-b693-14942e197db0', 'volume_name': 'volume-fd034a04-05aa-4592-b693-14942e197db0', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8808fe76-57d3-4b0d-b2ab-0aa9a62de410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8808fe76-57d3-4b0d-b2ab-0aa9a62de410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f340e81-b3d8-4d0e-a5e3-625da5d94f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume fd034a04-05aa-4592-b693-14942e197db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd034a04-05aa-4592-b693-14942e197db0', 'volume_size': 1} Jul 21 08:27:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (88276c4e-8a4d-4d1a-8096-d77f33571156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b5be72-9e6f-4ea0-99cd-4ee9b4431d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b5be72-9e6f-4ea0-99cd-4ee9b4431d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282786492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ba7be5-6e83-4d17-969d-591d2a2d313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709fec6a-f0d6-4ff8-a6d9-6dd2ed6aa6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709fec6a-f0d6-4ff8-a6d9-6dd2ed6aa6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113dbe9-4002-4267-9966-febf0947efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9113dbe9-4002-4267-9966-febf0947efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ba7be5-6e83-4d17-969d-591d2a2d313e', 'volume_name': 'volume-08ba7be5-6e83-4d17-969d-591d2a2d313e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f838b3c-1ec7-4497-a029-e3de95a0d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f838b3c-1ec7-4497-a029-e3de95a0d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011a2e3-f30e-49bd-b838-50f8069af017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Volume 08ba7be5-6e83-4d17-969d-591d2a2d313e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ba7be5-6e83-4d17-969d-591d2a2d313e', 'volume_size': 1} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:08 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae 1073741824" returned: 0 in 0.604s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:08 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae Jul 21 08:27:08 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (dcd27ac9-80f6-457d-a9ed-349564e175d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ffa3a8-7790-48c1-a069-249947f031d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ffa3a8-7790-48c1-a069-249947f031d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709199126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f368da15-54b2-4cee-b1c7-28a57c496ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:09Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce415e73-39a1-4f7a-8a6d-5e8bddf7643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce415e73-39a1-4f7a-8a6d-5e8bddf7643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a13bb6-4515-420f-b06a-0416dc7b544b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a13bb6-4515-420f-b06a-0416dc7b544b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f368da15-54b2-4cee-b1c7-28a57c496ebf', 'volume_name': 'volume-f368da15-54b2-4cee-b1c7-28a57c496ebf', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11574e2d-8b96-41e0-8d4e-b2dbe93924fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11574e2d-8b96-41e0-8d4e-b2dbe93924fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3cc4d51-8a4c-482a-b898-195fca776dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Volume f368da15-54b2-4cee-b1c7-28a57c496ebf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f368da15-54b2-4cee-b1c7-28a57c496ebf', 'volume_size': 1} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:08 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-127773271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd034a04-05aa-4592-b693-14942e197db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:08 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48e4bd7-1e5d-4fba-99b6-c5010bc354b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abae199-2526-426f-b6ad-d85017c9f636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:08 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 1073741824 Jul 21 08:27:08 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:08 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae (d6f9530a-674a-4de0-9e06-b40b3e9b2aae): created successfully Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abae199-2526-426f-b6ad-d85017c9f636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:08 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (461731fd-0dbd-4116-83c3-9a07c32d51af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-74c14d9e-2408-49f7-9c41-782c082fb936 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (263f04d7-4302-4c41-9f19-b4a13aea42b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3b2406-32af-4f5a-a8fd-d8ff3d7be957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3b2406-32af-4f5a-a8fd-d8ff3d7be957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665385922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b2d2cb-5df7-43aa-8726-c687326a705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:09Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127459d-1fdc-4169-8df5-1a0ed8be1957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6127459d-1fdc-4169-8df5-1a0ed8be1957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc474d2f-3806-4fad-a4c4-54a659798059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc474d2f-3806-4fad-a4c4-54a659798059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b2d2cb-5df7-43aa-8726-c687326a705e', 'volume_name': 'volume-70b2d2cb-5df7-43aa-8726-c687326a705e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddcfca7-e9ed-4dad-9794-2f51b6c33a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddcfca7-e9ed-4dad-9794-2f51b6c33a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129fc73a-d4c3-4bef-9ff8-d2c9b8541570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Volume 70b2d2cb-5df7-43aa-8726-c687326a705e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b2d2cb-5df7-43aa-8726-c687326a705e', 'volume_size': 1} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:09 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 1073741824" returned: 0 in 0.564s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:09 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 Jul 21 08:27:09 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (ebb30bf8-eb86-4e72-87cb-80c2d485cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8d9d3-102d-49c2-b8bc-82e4bcc085a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a8d9d3-102d-49c2-b8bc-82e4bcc085a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530515055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d6fa2d-393e-4706-871a-191c6954c3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9386df03-7cfd-42af-b045-4736e04e6139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9386df03-7cfd-42af-b045-4736e04e6139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44092008-adf4-44d7-8d7f-60246550434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44092008-adf4-44d7-8d7f-60246550434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d6fa2d-393e-4706-871a-191c6954c3a8', 'volume_name': 'volume-55d6fa2d-393e-4706-871a-191c6954c3a8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c5c660-32d9-43d4-87e2-7ecd47b29439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c5c660-32d9-43d4-87e2-7ecd47b29439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe18329-1099-4a1d-893b-149a5200a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Volume 55d6fa2d-393e-4706-871a-191c6954c3a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d6fa2d-393e-4706-871a-191c6954c3a8', 'volume_size': 1} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:09 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282786492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ba7be5-6e83-4d17-969d-591d2a2d313e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:08Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Creating volume 08ba7be5-6e83-4d17-969d-591d2a2d313e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:09 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f340e81-b3d8-4d0e-a5e3-625da5d94f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd034a04-05aa-4592-b693-14942e197db0', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd138001-5668-4c19-9559-e402c39efc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:09 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e 1073741824 Jul 21 08:27:09 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-fd034a04-05aa-4592-b693-14942e197db0 (fd034a04-05aa-4592-b693-14942e197db0): created successfully Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd138001-5668-4c19-9559-e402c39efc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e2250d93-19d9-44ad-ab39-db06bdbc1ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7c1a30b0-b766-4c83-809f-c1e293a32d58 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (c39745eb-8fb3-4c20-9a38-81522e4dc21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2231be1a-bd2c-4145-8a13-9a2f042b17d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2231be1a-bd2c-4145-8a13-9a2f042b17d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350299280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d715b24-2800-4df4-a2f9-93e89c41bdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40929de9-b260-488e-8a12-df6158a5c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40929de9-b260-488e-8a12-df6158a5c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a75ffe9-0758-4df7-8625-cb791a1af8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a75ffe9-0758-4df7-8625-cb791a1af8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d715b24-2800-4df4-a2f9-93e89c41bdf9', 'volume_name': 'volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579c9d55-a797-4cd3-b9b7-4a4e74128cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579c9d55-a797-4cd3-b9b7-4a4e74128cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ce455f-daa5-4afe-b333-5499b7c55afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Volume 1d715b24-2800-4df4-a2f9-93e89c41bdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9', 'volume_size': 1} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (572cf399-7193-49f7-b58d-df7d66e15ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba0d823-61e2-468d-8117-156ef93e1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba0d823-61e2-468d-8117-156ef93e1e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942347950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17037a04-d389-4637-b666-aef37cfa690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ec8e4-0b29-4604-bedf-774760f97f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411ec8e4-0b29-4604-bedf-774760f97f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365fc212-5217-49be-afca-931c3a7ece5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365fc212-5217-49be-afca-931c3a7ece5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17037a04-d389-4637-b666-aef37cfa690a', 'volume_name': 'volume-17037a04-d389-4637-b666-aef37cfa690a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a162c2a8-5353-4fe3-ab7d-2c489d540177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a162c2a8-5353-4fe3-ab7d-2c489d540177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6d22d8-a497-412f-a0b1-351f267923b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume 17037a04-d389-4637-b666-aef37cfa690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17037a04-d389-4637-b666-aef37cfa690a', 'volume_size': 1} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e 1073741824" returned: 0 in 0.660s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:10 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e Jul 21 08:27:10 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (c40c4e7f-e947-4499-8d6c-e80c81f28b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a787363-53ea-4631-8781-b6c6c784babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a787363-53ea-4631-8781-b6c6c784babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110898053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab977b8-0879-47c7-9879-8e70c1566bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:11Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1c9bc9-09da-45bc-8a85-414f0b41078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1c9bc9-09da-45bc-8a85-414f0b41078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09d324c-4982-4b78-82b9-cb9c8a8cfee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09d324c-4982-4b78-82b9-cb9c8a8cfee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab977b8-0879-47c7-9879-8e70c1566bc9', 'volume_name': 'volume-4ab977b8-0879-47c7-9879-8e70c1566bc9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6b71fd-a023-46de-9732-2e51f20755ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6b71fd-a023-46de-9732-2e51f20755ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccf6c2e-dfde-4a21-b86a-bccb2de475fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume 4ab977b8-0879-47c7-9879-8e70c1566bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab977b8-0879-47c7-9879-8e70c1566bc9', 'volume_size': 1} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:10 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709199126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f368da15-54b2-4cee-b1c7-28a57c496ebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:09Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Creating volume f368da15-54b2-4cee-b1c7-28a57c496ebf {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011a2e3-f30e-49bd-b838-50f8069af017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ba7be5-6e83-4d17-969d-591d2a2d313e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cdb018-190a-4986-b49e-4d5c69618479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf 1073741824 Jul 21 08:27:11 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Volume volume-08ba7be5-6e83-4d17-969d-591d2a2d313e (08ba7be5-6e83-4d17-969d-591d2a2d313e): created successfully Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cdb018-190a-4986-b49e-4d5c69618479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (88276c4e-8a4d-4d1a-8096-d77f33571156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bdb16d6c-5a1d-4f78-8c65-91f1dfec1969 tempest-CreateVolumesFromImageTest-717095722 None] Created volume successfully. Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (431148af-3cf2-467d-9437-69cdc506d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb372e-e086-4bac-a94b-7dedcabff325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bb372e-e086-4bac-a94b-7dedcabff325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279729829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43809779-8d50-409f-b003-e8250dab4048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:11Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1486332b-7be6-4b80-8a50-fb4218455b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1486332b-7be6-4b80-8a50-fb4218455b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd62010-c76e-4d4e-a845-5905a10b3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd62010-c76e-4d4e-a845-5905a10b3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43809779-8d50-409f-b003-e8250dab4048', 'volume_name': 'volume-43809779-8d50-409f-b003-e8250dab4048', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c5999-1c80-4ff4-bac3-8d71113f2b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c5999-1c80-4ff4-bac3-8d71113f2b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fd5830-1363-45ce-839e-695b1e458eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume 43809779-8d50-409f-b003-e8250dab4048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43809779-8d50-409f-b003-e8250dab4048', 'volume_size': 1} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:11 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf 1073741824" returned: 0 in 0.711s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:11 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf Jul 21 08:27:11 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (60eb6e02-0012-488e-ac73-f1e07c2604de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9f44eb-4ca4-44ef-9b60-15b34fa07807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9f44eb-4ca4-44ef-9b60-15b34fa07807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737481270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfb7970-328e-4b7e-9188-10dd526b9582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b44b12-9078-4935-9dd0-7db25b8b5cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b44b12-9078-4935-9dd0-7db25b8b5cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61182653-21f7-4769-8ae5-6ba9264d9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61182653-21f7-4769-8ae5-6ba9264d9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfb7970-328e-4b7e-9188-10dd526b9582', 'volume_name': 'volume-7bfb7970-328e-4b7e-9188-10dd526b9582', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78d476e-9dbb-4860-813e-fce47307b492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78d476e-9dbb-4860-813e-fce47307b492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caba8670-73fe-4f06-8abb-9a37dd04f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume 7bfb7970-328e-4b7e-9188-10dd526b9582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfb7970-328e-4b7e-9188-10dd526b9582', 'volume_size': 1} Jul 21 08:27:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:12 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665385922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b2d2cb-5df7-43aa-8726-c687326a705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:09Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Creating volume 70b2d2cb-5df7-43aa-8726-c687326a705e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3cc4d51-8a4c-482a-b898-195fca776dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f368da15-54b2-4cee-b1c7-28a57c496ebf', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e 1073741824 Jul 21 08:27:12 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d36f68-b746-4e3d-8232-1c7035f8ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Volume volume-f368da15-54b2-4cee-b1c7-28a57c496ebf (f368da15-54b2-4cee-b1c7-28a57c496ebf): created successfully Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d36f68-b746-4e3d-8232-1c7035f8ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (dcd27ac9-80f6-457d-a9ed-349564e175d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b195122b-79a4-4eca-bef0-da23d4e2c70c tempest-CreateVolumesFromImageTest-717095722 None] Created volume successfully. Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Flow 'volume_create_manager' (5a3d3ab3-5a77-4429-929e-f5354a8285cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22b4de8-f0a2-471a-a687-075dd7d8189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22b4de8-f0a2-471a-a687-075dd7d8189a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143db1e3-e1c1-478c-a66d-1f05af8b3a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dacbba845947daac2e4975e6179e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='3317dd44d5fe492b853fa1f21f789f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e21fd96-fe45-42f9-8dcc-a8f39610af39),volume_type_id=7e21fd96-fe45-42f9-8dcc-a8f39610af39)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb417a-7f8a-4f7b-8d5d-ee67d79fcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb417a-7f8a-4f7b-8d5d-ee67d79fcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5659490-e503-4fe6-9da1-ddf142c99f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (381e7950-7fd6-4547-9e2f-7154f7b2e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d4471f-befa-47b7-8085-6a82dd38e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d4471f-befa-47b7-8085-6a82dd38e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793802023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400cf657-ee1e-444a-9f84-8dea64022fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400cf657-ee1e-444a-9f84-8dea64022fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c3958-28ff-4fed-aff2-09e8b76f6fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292c3958-28ff-4fed-aff2-09e8b76f6fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa', 'volume_name': 'volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3842ed-e470-4764-94a2-66e0f9c02ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3842ed-e470-4764-94a2-66e0f9c02ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8061bc-766c-4ae1-9615-8235d94b9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa', 'volume_size': 1} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:12 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e 1073741824" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:12 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e Jul 21 08:27:12 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5659490-e503-4fe6-9da1-ddf142c99f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '143db1e3-e1c1-478c-a66d-1f05af8b3a81', 'volume_name': 'volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81', 'volume_size': 1, 'image_id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab642f1f8963e9773f9bf33ae13c04a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54dacbba845947daac2e4975e6179e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dafd1f77521059fa120a3028e49979eb98147aec7868d9f8d7cdd908f48aaf5ed7dbd76b686e3cc568ee7680df66cf4900710c3d66ceb8d1c2b2195f2ea8430', 'id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b52adec1-9881-4c22-a93d-a2bf42509b4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f045ef5-d6e4-45ba-9b1d-22bb092ff596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f045ef5-d6e4-45ba-9b1d-22bb092ff596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce66771a-1d33-4608-8e15-b80970a53e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81', 'volume_size': 1, 'image_id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab642f1f8963e9773f9bf33ae13c04a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54dacbba845947daac2e4975e6179e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dafd1f77521059fa120a3028e49979eb98147aec7868d9f8d7cdd908f48aaf5ed7dbd76b686e3cc568ee7680df66cf4900710c3d66ceb8d1c2b2195f2ea8430', 'id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b52adec1-9881-4c22-a93d-a2bf42509b4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Trying to clone 143db1e3-e1c1-478c-a66d-1f05af8b3a81 from image b52adec1-9881-4c22-a93d-a2bf42509b4b at location (None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:27:12 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e" returned: 0 in 0.257s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530515055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d6fa2d-393e-4706-871a-191c6954c3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Creating volume 55d6fa2d-393e-4706-871a-191c6954c3a8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:27:12 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Image download 0.00 MB at 0.00 MB/s Jul 21 08:27:12 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 1073741824 Jul 21 08:27:12 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129fc73a-d4c3-4bef-9ff8-d2c9b8541570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b2d2cb-5df7-43aa-8726-c687326a705e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2854ac27-67e5-4d31-abe0-43da20a011d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Volume volume-70b2d2cb-5df7-43aa-8726-c687326a705e (70b2d2cb-5df7-43aa-8726-c687326a705e): created successfully Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2854ac27-67e5-4d31-abe0-43da20a011d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (263f04d7-4302-4c41-9f19-b4a13aea42b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c2c0fc-8991-4be9-ae2d-bc1e9bcac3a6]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f7c01ad2-ddec-45db-8cbe-96f2ff36750c tempest-CreateVolumesFromImageTest-717095722 None] Created volume successfully. Jul 21 08:27:13 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:13 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:13 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:13 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 1073741824" returned: 0 in 0.435s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:13 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 Jul 21 08:27:13 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:13 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:13 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:13 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1350299280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d715b24-2800-4df4-a2f9-93e89c41bdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa84e0e877eb4a01bcd867b0b0c0c98f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='60644215128147d7a01a5e2f53a8debf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Creating volume 1d715b24-2800-4df4-a2f9-93e89c41bdf9 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:13 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Temporary image b52adec1-9881-4c22-a93d-a2bf42509b4b is fetched for user 3317dd44d5fe492b853fa1f21f789f27. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:27:13 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 1073741824 Jul 21 08:27:13 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe18329-1099-4a1d-893b-149a5200a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d6fa2d-393e-4706-871a-191c6954c3a8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fe0fdb-095b-46e3-85a3-b0d132e9f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Volume volume-55d6fa2d-393e-4706-871a-191c6954c3a8 (55d6fa2d-393e-4706-871a-191c6954c3a8): created successfully Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fe0fdb-095b-46e3-85a3-b0d132e9f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (ebb30bf8-eb86-4e72-87cb-80c2d485cc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dcf07e07-122a-4702-b235-fe13d19b13bb tempest-CreateVolumesFromImageTest-717095722 None] Created volume successfully. Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c6bd8-ce8b-4bf2-b2d3-b3dc42511319]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:13 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:13 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:14 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 1073741824" returned: 0 in 0.411s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:14 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:14 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 Jul 21 08:27:14 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:14 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:14 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:14 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.852s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1942347950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17037a04-d389-4637-b666-aef37cfa690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:10Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume 17037a04-d389-4637-b666-aef37cfa690a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:14 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ce455f-daa5-4afe-b333-5499b7c55afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:14 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a 1073741824 Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbdfde0-4213-425a-9c9c-7f35533d067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:14 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Volume volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 (1d715b24-2800-4df4-a2f9-93e89c41bdf9): created successfully Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbdfde0-4213-425a-9c9c-7f35533d067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Flow 'volume_create_manager' (c39745eb-8fb3-4c20-9a38-81522e4dc21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-da525143-a1f0-4157-a809-4b053a9ca511 tempest-CreateVolumesFromImageTest-717095722 None] Created volume successfully. Jul 21 08:27:14 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-1d715b24-2800-4df4-a2f9-93e89c41bdf9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-1d715b24-2800-4df4-a2f9-93e89c41bdf9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-quobyte-1d715b24-2800-4df4-a2f9-93e89c41bdf9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-1d715b24-2800-4df4-a2f9-93e89c41bdf9" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e108336d-6177-429f-a338-8f1308907504]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:14 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a 1073741824" returned: 0 in 0.473s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:14 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 Jul 21 08:27:14 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:14 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a Jul 21 08:27:14 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:15 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9" returned: 0 in 0.357s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:15 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:15 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9 Jul 21 08:27:15 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.234s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110898053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab977b8-0879-47c7-9879-8e70c1566bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:11Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume 4ab977b8-0879-47c7-9879-8e70c1566bc9 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:15 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6d22d8-a497-412f-a0b1-351f267923b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17037a04-d389-4637-b666-aef37cfa690a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a73e043-01c7-4aa5-a1bf-35b9b66cc819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:15 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 1073741824 Jul 21 08:27:15 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:15 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-17037a04-d389-4637-b666-aef37cfa690a (17037a04-d389-4637-b666-aef37cfa690a): created successfully Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a73e043-01c7-4aa5-a1bf-35b9b66cc819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (572cf399-7193-49f7-b58d-df7d66e15ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08165b67-ea9b-4276-994b-38fcf65237b8 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:15 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1d715b24-2800-4df4-a2f9-93e89c41bdf9" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-1d715b24-2800-4df4-a2f9-93e89c41bdf9" released by "delete_volume" :: held 0.675s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Created reservations ['c6cd62e2-b4ff-4761-b489-6e20e901cb1b', 'a5bedc20-465d-4d2f-bbff-94596737ede6', '5bb715fc-0cc6-41da-9fd7-e9f1bb82d439', '45da6290-37d2-47c1-b5fe-5ffda84ac947'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:15 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:15 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:15 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 1073741824" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:15 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 Jul 21 08:27:15 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:15 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.280s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Deleted volume successfully. Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-55d6fa2d-393e-4706-871a-191c6954c3a8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-55d6fa2d-393e-4706-871a-191c6954c3a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6dd2f6e5-4d78-4aa3-8039-06b388b6ea9f tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-1d715b24-2800-4df4-a2f9-93e89c41bdf9-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-quobyte-55d6fa2d-393e-4706-871a-191c6954c3a8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-55d6fa2d-393e-4706-871a-191c6954c3a8" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:15 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.575s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb3bd76-0e1c-4927-8e04-aa65e4cc3a67]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fccf6c2e-dfde-4a21-b86a-bccb2de475fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab977b8-0879-47c7-9879-8e70c1566bc9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed930e4a-bb67-42d5-b9b8-c435ed1ef98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating offline snapshot c2a1e760-479e-4a2c-8955-bdadc42d7b44 of volume fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:27:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 (4ab977b8-0879-47c7-9879-8e70c1566bc9): created successfully Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed930e4a-bb67-42d5-b9b8-c435ed1ef98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (c40c4e7f-e947-4499-8d6c-e80c81f28b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d83f7b-138f-4b9e-912f-742fa23bbb04]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4f4b23f3-1e66-4214-9412-9c9c10e4e807 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:16 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 Jul 21 08:27:16 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:16 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 Jul 21 08:27:16 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:16 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8" returned: 0 in 0.415s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8 Jul 21 08:27:16 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:16 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 1G Jul 21 08:27:16 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:16 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-55d6fa2d-393e-4706-871a-191c6954c3a8" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-55d6fa2d-393e-4706-871a-191c6954c3a8" released by "delete_volume" :: held 0.714s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Created reservations ['e20cd41c-4255-44a5-a036-7cbce25ae3b7', '37f3d328-2595-494d-be30-b3370805da2e', 'b595e35b-81fa-42d3-a663-fbc0ceaf5bb1', 'afc46a9e-90f7-4c99-ab12-8fc74160e387'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:16 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:16 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 1G" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd034a04-05aa-4592-b693-14942e197db0 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:16 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd034a04-05aa-4592-b693-14942e197db0 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 Jul 21 08:27:16 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-70b2d2cb-5df7-43aa-8726-c687326a705e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:17 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.253s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-70b2d2cb-5df7-43aa-8726-c687326a705e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Deleted volume successfully. Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-6895f6ec-3bde-4a2e-8fae-fc21efc70287 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-55d6fa2d-393e-4706-871a-191c6954c3a8-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-quobyte-70b2d2cb-5df7-43aa-8726-c687326a705e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-70b2d2cb-5df7-43aa-8726-c687326a705e" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3187edb7-6d18-4041-a3a6-0c9a1d2f68ce]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd034a04-05aa-4592-b693-14942e197db0 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44" returned: 0 in 0.344s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 is being set with open permissions: ugo+rw Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e Jul 21 08:27:17 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 Jul 21 08:27:17 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e" returned: 0 in 0.353s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e Jul 21 08:27:17 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info Jul 21 08:27:17 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-70b2d2cb-5df7-43aa-8726-c687326a705e" returned: 0 in 0.264s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-70b2d2cb-5df7-43aa-8726-c687326a705e" released by "delete_volume" :: held 0.657s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:17 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:17 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info is being set with open permissions: ugo+rw Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info Jul 21 08:27:17 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Created reservations ['f2cda38f-cf51-48de-94e4-68b921b4483a', 'cff79155-b5a8-4229-80fe-a27e18b12d26', 'b5be68d2-3cb0-4dae-8325-2a7f40ea214d', '79d3f3d2-52e0-46bc-beb6-568a418b8437'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:17 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:17 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:18 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.info" returned: 0 in 0.241s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.388s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279729829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43809779-8d50-409f-b003-e8250dab4048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:11Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume 43809779-8d50-409f-b003-e8250dab4048 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:18 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:18 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 1073741824 Jul 21 08:27:18 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-de6756ad-c78e-4328-832a-4953ed66443d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Create snapshot completed successfully Jul 21 08:27:18 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Deleted volume successfully. Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-9573ec2e-ba42-414c-ba7c-ba9f4c6452af tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-70b2d2cb-5df7-43aa-8726-c687326a705e-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-f368da15-54b2-4cee-b1c7-28a57c496ebf-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-f368da15-54b2-4cee-b1c7-28a57c496ebf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-quobyte-f368da15-54b2-4cee-b1c7-28a57c496ebf" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-f368da15-54b2-4cee-b1c7-28a57c496ebf" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f118d-812e-4d4a-8ffa-533f898b24b9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:18 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf Jul 21 08:27:18 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:18 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 1073741824" returned: 0 in 0.578s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:18 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 Jul 21 08:27:18 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:18 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf" returned: 0 in 0.508s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:18 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf Jul 21 08:27:18 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:19 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.051s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737481270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfb7970-328e-4b7e-9188-10dd526b9582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume 7bfb7970-328e-4b7e-9188-10dd526b9582 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fd5830-1363-45ce-839e-695b1e458eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43809779-8d50-409f-b003-e8250dab4048', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 1073741824 Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0ef1a7-49f8-48f2-b7d3-deb7dac9d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (07e59949-eb8e-4eb8-a410-928b86fc1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc622458-588b-416e-8beb-ff8f07f216e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-43809779-8d50-409f-b003-e8250dab4048 (43809779-8d50-409f-b003-e8250dab4048): created successfully Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0ef1a7-49f8-48f2-b7d3-deb7dac9d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (431148af-3cf2-467d-9437-69cdc506d5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc622458-588b-416e-8beb-ff8f07f216e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094537461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89fff88-339e-42c0-9a60-c6c8d616fe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:19Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d80df7f-ff04-4b89-9a4c-ed5e59f5ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d80df7f-ff04-4b89-9a4c-ed5e59f5ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54340eed-9bf8-4969-979a-4d281f8558c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54340eed-9bf8-4969-979a-4d281f8558c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89fff88-339e-42c0-9a60-c6c8d616fe7d', 'volume_name': 'volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3e2d10-dafa-4917-a6fd-311cc2030ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3e2d10-dafa-4917-a6fd-311cc2030ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21b8e8b-8559-4da5-8248-9c68f1d291d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume b89fff88-339e-42c0-9a60-c6c8d616fe7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d', 'volume_size': 1} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e9f98eea-b8aa-4ef0-8e84-7d02f29f02cc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:19 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-f368da15-54b2-4cee-b1c7-28a57c496ebf" returned: 0 in 0.364s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-f368da15-54b2-4cee-b1c7-28a57c496ebf" released by "delete_volume" :: held 0.936s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Created reservations ['7e17d01e-7d60-4f2d-bf26-80e028335cef', '01dc3279-e8a5-4095-b04b-1a2d21d41ecb', '67823467-ed8a-45b6-b0ec-4c2a98527610', 'a9202988-275b-480e-9a33-31c0bbfa0f2f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (9e377835-8ad2-4583-8843-6a54dbebec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80916aab-6969-4794-90f5-c23930e02c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80916aab-6969-4794-90f5-c23930e02c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018864866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b86f31-2bda-4c82-a693-244698134a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:19Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbefef49-5a17-4c16-901f-a83015737b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbefef49-5a17-4c16-901f-a83015737b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132bfc20-d962-4301-ac89-402278120bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132bfc20-d962-4301-ac89-402278120bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b86f31-2bda-4c82-a693-244698134a7c', 'volume_name': 'volume-e7b86f31-2bda-4c82-a693-244698134a7c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf268c-48ce-413b-a039-812d489ef0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbf268c-48ce-413b-a039-812d489ef0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db0ae9-30da-4dcf-96c2-b3c1742d8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume e7b86f31-2bda-4c82-a693-244698134a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b86f31-2bda-4c82-a693-244698134a7c', 'volume_size': 1} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-08ba7be5-6e83-4d17-969d-591d2a2d313e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:19 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:19 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-08ba7be5-6e83-4d17-969d-591d2a2d313e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "cinder-quobyte-08ba7be5-6e83-4d17-969d-591d2a2d313e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:19 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 1073741824" returned: 0 in 0.625s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-08ba7be5-6e83-4d17-969d-591d2a2d313e" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6ad420-bc39-4a69-be9b-a77cdcb9a9c9]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:19 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 Jul 21 08:27:19 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:19 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:19 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e Jul 21 08:27:19 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.370s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:19 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Deleted volume successfully. Jul 21 08:27:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-64568ddc-3e03-452e-89c1-ba94f0a610b6 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-f368da15-54b2-4cee-b1c7-28a57c496ebf-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:20 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582" returned: 0 in 0.313s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.408s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793802023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abee3b707d17428e92c01e05f29a26e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='dfb40330b8aa491c9af73426e0bb93f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Creating volume bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:20 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caba8670-73fe-4f06-8abb-9a37dd04f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfb7970-328e-4b7e-9188-10dd526b9582', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebc509-10d8-4f1a-a2f2-6de9efc47017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa 1073741824 Jul 21 08:27:20 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (f9fc90de-7314-412c-8401-9a4e8b74250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b9941-040b-40cc-9f70-066382e4714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-7bfb7970-328e-4b7e-9188-10dd526b9582 (7bfb7970-328e-4b7e-9188-10dd526b9582): created successfully Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ebc509-10d8-4f1a-a2f2-6de9efc47017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (60eb6e02-0012-488e-ac73-f1e07c2604de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854b9941-040b-40cc-9f70-066382e4714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511524258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942e9ba0-8272-4908-91e1-d66815710fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:20Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a67624e-3291-46e4-afdd-0bd0950e8e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a67624e-3291-46e4-afdd-0bd0950e8e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d96638d-fdbd-4858-b368-08b76ab5ac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d96638d-fdbd-4858-b368-08b76ab5ac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942e9ba0-8272-4908-91e1-d66815710fed', 'volume_name': 'volume-942e9ba0-8272-4908-91e1-d66815710fed', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa99c0c-44c4-47a9-a32e-855a6290f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa99c0c-44c4-47a9-a32e-855a6290f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475fa47f-df50-4488-8974-b7dcc3f2d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume 942e9ba0-8272-4908-91e1-d66815710fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942e9ba0-8272-4908-91e1-d66815710fed', 'volume_size': 1} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e" returned: 0 in 0.525s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-54f1bce9-f3b5-4955-8a44-01808fc4d55b tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:20 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e Jul 21 08:27:20 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e537611f-d010-48f9-bfca-82dee8d34822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce91d48-79a1-40c5-a254-40fde68ab015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-08ba7be5-6e83-4d17-969d-591d2a2d313e" returned: 0 in 0.313s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce91d48-79a1-40c5-a254-40fde68ab015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-683199538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bce578-0c9d-4343-bd9c-4587dd6c0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:20Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8214d609-82e5-432c-b812-f288c78a3c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8214d609-82e5-432c-b812-f288c78a3c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f533321a-e147-4210-8a38-415a515ba5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f533321a-e147-4210-8a38-415a515ba5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8bce578-0c9d-4343-bd9c-4587dd6c0454', 'volume_name': 'volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec949ef5-75a5-453b-8d2d-44fad777cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec949ef5-75a5-453b-8d2d-44fad777cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99b1184-e56a-48d0-8cf8-c2a15cf50f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume c8bce578-0c9d-4343-bd9c-4587dd6c0454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454', 'volume_size': 1} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa 1073741824" returned: 0 in 0.594s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-quobyte-08ba7be5-6e83-4d17-969d-591d2a2d313e" released by "delete_volume" :: held 0.983s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:20 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa Jul 21 08:27:20 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Created reservations ['ff2920fe-4e5d-4645-800a-b76d1c56feb2', '3e4096bb-5648-4ba7-8c60-ad0514fced2c', 'ccfe9282-0cb4-4bf7-96f4-5df6763c7659', '084c0677-b98d-44c5-be76-607baa2f4c32'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:20 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:20 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e098bb9f-5c06-4b41-8223-80d3486487c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6732a29-6366-4288-b33a-c04feb62c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6732a29-6366-4288-b33a-c04feb62c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217523154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0f1f19-d32d-42bd-b693-138469dd237c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:21Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d073d09-0c41-4ce5-bf49-89ae668334e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d073d09-0c41-4ce5-bf49-89ae668334e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293fefc5-0fff-482f-8116-3972b8adf32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293fefc5-0fff-482f-8116-3972b8adf32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0f1f19-d32d-42bd-b693-138469dd237c', 'volume_name': 'volume-1a0f1f19-d32d-42bd-b693-138469dd237c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dc4290-6340-46da-8eef-603020d0569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dc4290-6340-46da-8eef-603020d0569e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4ce06-00c3-4a0c-9a57-ea662679f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume 1a0f1f19-d32d-42bd-b693-138469dd237c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0f1f19-d32d-42bd-b693-138469dd237c', 'volume_size': 1} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:21 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.509s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143db1e3-e1c1-478c-a66d-1f05af8b3a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54dacbba845947daac2e4975e6179e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:12Z,use_quota=True,user_id='3317dd44d5fe492b853fa1f21f789f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e21fd96-fe45-42f9-8dcc-a8f39610af39),volume_type_id=7e21fd96-fe45-42f9-8dcc-a8f39610af39)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Creating volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8061bc-766c-4ae1-9615-8235d94b9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6659acdc-0c0a-4901-b590-a676d0e08a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:21 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1073741824 Jul 21 08:27:21 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Volume volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa (bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa): created successfully Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6659acdc-0c0a-4901-b590-a676d0e08a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Flow 'volume_create_manager' (381e7950-7fd6-4547-9e2f-7154f7b2e451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d7a5c1f3-a8c4-4347-8522-ffa5bf0cd5b1 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created volume successfully. Jul 21 08:27:21 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Deleted volume successfully. Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52b0fed9-3204-46bf-963c-bbd095c34f65 tempest-CreateVolumesFromImageTest-717095722 None] Lock "cinder-08ba7be5-6e83-4d17-969d-591d2a2d313e-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:21 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1073741824" returned: 0 in 0.443s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:21 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 Jul 21 08:27:21 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:21 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094537461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89fff88-339e-42c0-9a60-c6c8d616fe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:19Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume b89fff88-339e-42c0-9a60-c6c8d616fe7d {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:21 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d 1073741824 Jul 21 08:27:21 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Attempting download of b52adec1-9881-4c22-a93d-a2bf42509b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}])) to volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e81e6d-b479-4010-a9e5-6ce8850df54d]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt Jul 21 08:27:22 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b1c733-122a-48d7-a248-5712a51f3c7e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt" returned: 0 in 0.389s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d 1073741824" returned: 0 in 0.548s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:22 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa Jul 21 08:27:22 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt Jul 21 08:27:22 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d Jul 21 08:27:22 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d" returned: 0 in 0.297s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.216s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1018864866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b86f31-2bda-4c82-a693-244698134a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:19Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume e7b86f31-2bda-4c82-a693-244698134a7c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:22 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:22 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" returned: 0 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt" returned: 1 in 0.427s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b52adec1-9881-4c22-a93d-a2bf42509b4b_hasjkijt' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c 1073741824 Jul 21 08:27:22 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d0fd4-5ab0-4752-bd02-a59862decff9]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:22 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa Jul 21 08:27:22 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21b8e8b-8559-4da5-8248-9c68f1d291d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33e41c-2059-4aeb-b5d3-665017df946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:22 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d (b89fff88-339e-42c0-9a60-c6c8d616fe7d): created successfully Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b33e41c-2059-4aeb-b5d3-665017df946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (07e59949-eb8e-4eb8-a410-928b86fc1a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-628666ac-4296-419a-a127-727857c71bf4 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:23 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:23 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa" released by "delete_volume" :: held 0.838s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['d7a1479e-3cb3-424d-aef8-6e1a484e525d', 'cc48a592-8804-4d3f-96e8-ae2ca7362eac', '8c289495-c56e-478a-839a-70e13cb8ac31', 'ee8be470-0543-4fe5-95de-2a44d96d1d91'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:23 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:23 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c 1073741824" returned: 0 in 0.599s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-7bfb7970-328e-4b7e-9188-10dd526b9582-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-7bfb7970-328e-4b7e-9188-10dd526b9582-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:23 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c Jul 21 08:27:23 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-7bfb7970-328e-4b7e-9188-10dd526b9582" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-7bfb7970-328e-4b7e-9188-10dd526b9582" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:23 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD Jul 21 08:27:23 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af60e5-9a07-42a3-a945-0c338a4d6a59]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:23 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.424s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-327c0385-ad13-4a52-8bdc-5f087f8c586f tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-bfdd0ab2-6c43-4f7d-8cf3-93aa67ff53fa-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:23 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 Jul 21 08:27:23 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c" returned: 0 in 0.408s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.611s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511524258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942e9ba0-8272-4908-91e1-d66815710fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:20Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume 942e9ba0-8272-4908-91e1-d66815710fed {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:23 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:23 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db0ae9-30da-4dcf-96c2-b3c1742d8605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b86f31-2bda-4c82-a693-244698134a7c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:23 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed 1073741824 Jul 21 08:27:23 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785bc300-c688-40c5-b2c7-331ce427a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD" returned: 1 in 0.550s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] b52adec1-9881-4c22-a93d-a2bf42509b4b was raw, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:27:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-e7b86f31-2bda-4c82-a693-244698134a7c (e7b86f31-2bda-4c82-a693-244698134a7c): created successfully Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (785bc300-c688-40c5-b2c7-331ce427a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:24 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 Jul 21 08:27:24 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (9e377835-8ad2-4583-8843-6a54dbebec48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-14bb3b78-f789-4cff-b265-a185651f3c0c tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:24 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582" returned: 0 in 0.534s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582 Jul 21 08:27:24 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7bfb7970-328e-4b7e-9188-10dd526b9582" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-7bfb7970-328e-4b7e-9188-10dd526b9582" released by "delete_volume" :: held 0.891s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed 1073741824" returned: 0 in 0.605s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed Jul 21 08:27:24 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['0801261c-e6e9-4542-a6ce-8d2a6405fca0', 'c9d636ff-46e3-45d6-bdf0-4dec75049d9e', 'e6761dc6-0df2-4c63-bbc0-83bea1081360', '8451f1a3-fc7c-4f66-a460-df53b4e9a110'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:24 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81" returned: 0 in 0.646s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b52adec1-9881-4c22-a93d-a2bf42509b4b_kut_hk7qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1G Jul 21 08:27:24 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:24 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed" returned: 0 in 0.346s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.221s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-683199538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bce578-0c9d-4343-bd9c-4587dd6c0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:20Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume c8bce578-0c9d-4343-bd9c-4587dd6c0454 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475fa47f-df50-4488-8974-b7dcc3f2d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942e9ba0-8272-4908-91e1-d66815710fed', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a87415-46b3-4aba-85ef-791d267459f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:24 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 1073741824 Jul 21 08:27:24 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-942e9ba0-8272-4908-91e1-d66815710fed (942e9ba0-8272-4908-91e1-d66815710fed): created successfully Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a87415-46b3-4aba-85ef-791d267459f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (f9fc90de-7314-412c-8401-9a4e8b74250b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:24 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b311a2be-1d9e-41e2-a7a6-c9058cb49203 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:24 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.298s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:24 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-44663b77-781c-4f67-80af-b30171ef6383 tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-7bfb7970-328e-4b7e-9188-10dd526b9582-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:25 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 1G" returned: 0 in 0.459s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Downloaded image b52adec1-9881-4c22-a93d-a2bf42509b4b ((None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}])) to volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81 successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Temporary image b52adec1-9881-4c22-a93d-a2bf42509b4b for user 3317dd44d5fe492b853fa1f21f789f27 is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Marking volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81 as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Copying metadata from image b52adec1-9881-4c22-a93d-a2bf42509b4b to 143db1e3-e1c1-478c-a66d-1f05af8b3a81. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Creating volume glance metadata for volume 143db1e3-e1c1-478c-a66d-1f05af8b3a81 backed by image b52adec1-9881-4c22-a93d-a2bf42509b4b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fab642f1f8963e9773f9bf33ae13c04a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce66771a-1d33-4608-8e15-b80970a53e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81', 'volume_size': 1, 'image_id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b52adec1-9881-4c22-a93d-a2bf42509b4b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab642f1f8963e9773f9bf33ae13c04a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54dacbba845947daac2e4975e6179e1b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9dafd1f77521059fa120a3028e49979eb98147aec7868d9f8d7cdd908f48aaf5ed7dbd76b686e3cc568ee7680df66cf4900710c3d66ceb8d1c2b2195f2ea8430', 'id': 'b52adec1-9881-4c22-a93d-a2bf42509b4b', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b52adec1-9881-4c22-a93d-a2bf42509b4b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb6788c-ebdd-46d9-a767-09e71960e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Volume volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 (143db1e3-e1c1-478c-a66d-1f05af8b3a81): created successfully Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb6788c-ebdd-46d9-a767-09e71960e092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Flow 'volume_create_manager' (5a3d3ab3-5a77-4429-929e-f5354a8285cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f88c6a2d-f987-4ac7-aeee-7869e4ea9b7e tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Created volume successfully. Jul 21 08:27:25 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 1073741824" returned: 0 in 0.562s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:25 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 Jul 21 08:27:25 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-43809779-8d50-409f-b003-e8250dab4048-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-43809779-8d50-409f-b003-e8250dab4048-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-43809779-8d50-409f-b003-e8250dab4048" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-43809779-8d50-409f-b003-e8250dab4048" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab94c724-8789-4c03-bd6e-a6b083e95d52]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:25 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.781s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217523154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0f1f19-d32d-42bd-b693-138469dd237c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f297ba8b864364ae0183a529ace808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:21Z,use_quota=True,user_id='bdc97f8984e1476aa201cf7316f51c53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Creating volume 1a0f1f19-d32d-42bd-b693-138469dd237c {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:25 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c 1073741824 Jul 21 08:27:25 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99b1184-e56a-48d0-8cf8-c2a15cf50f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549554bd-ca75-4323-b2eb-821a33b559c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 (c8bce578-0c9d-4343-bd9c-4587dd6c0454): created successfully Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549554bd-ca75-4323-b2eb-821a33b559c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:25 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 Jul 21 08:27:25 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e537611f-d010-48f9-bfca-82dee8d34822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b9d9328d-96a2-4a87-b8d5-41edc0a83caf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:26 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048" returned: 0 in 0.435s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:26 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048 Jul 21 08:27:26 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Acquiring lock "cinder-143db1e3-e1c1-478c-a66d-1f05af8b3a81-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "cinder-143db1e3-e1c1-478c-a66d-1f05af8b3a81-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Acquiring lock "cinder-quobyte-143db1e3-e1c1-478c-a66d-1f05af8b3a81" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "cinder-quobyte-143db1e3-e1c1-478c-a66d-1f05af8b3a81" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:26 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c 1073741824" returned: 0 in 0.591s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4640df-47bc-4b63-9ad4-576bb65d916e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:26 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c Jul 21 08:27:26 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:26 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-43809779-8d50-409f-b003-e8250dab4048" returned: 0 in 0.302s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-43809779-8d50-409f-b003-e8250dab4048" released by "delete_volume" :: held 0.783s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:26 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 Jul 21 08:27:26 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['0db938d1-a355-4fbe-9927-91f6a0adf3a9', 'b4af970e-f133-4a8f-8e2b-56c5bbc49306', '50743e8e-ffea-402a-ba6f-58bbdc21ef78', 'f3dcc4a4-5b1f-4703-a6c1-783de7ed811a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:26 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:26 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:26 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c" returned: 0 in 0.378s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-4ab977b8-0879-47c7-9879-8e70c1566bc9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f4ce06-00c3-4a0c-9a57-ea662679f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0f1f19-d32d-42bd-b693-138469dd237c', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e3a97c-4d15-4e61-a311-c1d2f6b2ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Volume volume-1a0f1f19-d32d-42bd-b693-138469dd237c (1a0f1f19-d32d-42bd-b693-138469dd237c): created successfully Jul 21 08:27:26 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e3a97c-4d15-4e61-a311-c1d2f6b2ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Flow 'volume_create_manager' (e098bb9f-5c06-4b41-8223-80d3486487c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81" returned: 0 in 0.521s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-4ab977b8-0879-47c7-9879-8e70c1566bc9-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0d5a62b2-eb87-4220-a5de-6ab44e717ea9 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created volume successfully. Jul 21 08:27:26 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81 Jul 21 08:27:26 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-4ab977b8-0879-47c7-9879-8e70c1566bc9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-4ab977b8-0879-47c7-9879-8e70c1566bc9" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:27 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf1faa-bf30-4b2e-b3ba-7d212c0314d8]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0fbb6eb5-5007-4459-b709-d80ae0148dfc tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-43809779-8d50-409f-b003-e8250dab4048-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:27 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 Jul 21 08:27:27 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:27 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-143db1e3-e1c1-478c-a66d-1f05af8b3a81" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "cinder-quobyte-143db1e3-e1c1-478c-a66d-1f05af8b3a81" released by "delete_volume" :: held 0.890s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Created reservations ['8287ced8-136d-48f1-a707-8fc81a12e06f', '478631a1-fb6c-4280-8bfb-17d93a311b16', '39d19fba-75a0-4ce1-8c1c-45f0320b663d', 'ac537e16-3807-48f2-8ba2-0a506d08c4cc'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:27 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:27 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:27 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9" returned: 0 in 0.443s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:27 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9 Jul 21 08:27:27 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:27 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.295s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Deleted volume successfully. Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-55059c07-ec8e-44e5-bf91-70058a29bdd2 tempest-VolumeAndVolumeTypeFromImageTest-1348572871 None] Lock "cinder-143db1e3-e1c1-478c-a66d-1f05af8b3a81-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-1a0f1f19-d32d-42bd-b693-138469dd237c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-1a0f1f19-d32d-42bd-b693-138469dd237c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-1a0f1f19-d32d-42bd-b693-138469dd237c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:27 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4ab977b8-0879-47c7-9879-8e70c1566bc9" returned: 0 in 0.328s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-1a0f1f19-d32d-42bd-b693-138469dd237c" acquired by "delete_volume" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-4ab977b8-0879-47c7-9879-8e70c1566bc9" released by "delete_volume" :: held 0.851s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e439b-91b3-4208-9ebb-987c57e7f86b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:27 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['597b5893-4a1c-4683-b470-5595c04fdfdd', '3e7811e0-6922-481c-8e0c-b645681318da', '2f150bd4-54cf-4dc0-a2b0-219e59c2a8ec', '500c6709-9152-4f83-a62e-a00a7038ddb7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:28 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c Jul 21 08:27:28 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:28 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:28 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:28 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.284s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b044be5a-c9fc-4f53-8d0b-def5273548ba tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-4ab977b8-0879-47c7-9879-8e70c1566bc9-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:28 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:28 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c Jul 21 08:27:28 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Flow 'volume_create_manager' (e5611680-24de-4236-8cfc-8bd69e4593d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7310d5-7ca6-49c4-9020-7e6dd158110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7310d5-7ca6-49c4-9020-7e6dd158110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8dd6d7-da50-4186-8e0c-6decf909767f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea6c15aa24e4bce8e62d6355c3c19fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:28Z,use_quota=True,user_id='09b5c57feb634f8bab36d23f429e98eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b6ed37-9ee6-4ec5-a7d5-4a73d1b0d3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b6ed37-9ee6-4ec5-a7d5-4a73d1b0d3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbd536f-9a0e-49ea-bb53-47139c0a0257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.image.glance [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Creating Keystone auth plugin from conf {{(pid=87372) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 21 08:27:28 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-1a0f1f19-d32d-42bd-b693-138469dd237c" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-1a0f1f19-d32d-42bd-b693-138469dd237c" released by "delete_volume" :: held 0.838s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['b618ed57-cbad-4f89-99ba-f2bc0968a2f5', '4ee73c37-7195-467f-b3fb-b661d8cff78c', '5972b7eb-3a47-4e38-92c7-8a46573b5dd7', '7595db1c-9f89-49f5-8bc2-c2781c0d09bf'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:28 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:28 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbd536f-9a0e-49ea-bb53-47139c0a0257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a8dd6d7-da50-4186-8e0c-6decf909767f', 'volume_name': 'volume-3a8dd6d7-da50-4186-8e0c-6decf909767f', 'volume_size': 1, 'image_id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ff61734aa421da797c479f2d8ecb7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aea6c15aa24e4bce8e62d6355c3c19fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c812cea27dbad195ec3ed9ab5327c3e5768a3052af9f71aa1e90fe10047b9947f67b6251ece12323057a07f8cf8532643d7489c35fbecb5528846749ed7614bd', 'id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a38cac-2aa4-4d6a-b3d7-41729e270f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a38cac-2aa4-4d6a-b3d7-41729e270f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3436752-18cc-4007-8823-d31e17ab33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:28 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Volume 3a8dd6d7-da50-4186-8e0c-6decf909767f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a8dd6d7-da50-4186-8e0c-6decf909767f', 'volume_size': 1, 'image_id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ff61734aa421da797c479f2d8ecb7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aea6c15aa24e4bce8e62d6355c3c19fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c812cea27dbad195ec3ed9ab5327c3e5768a3052af9f71aa1e90fe10047b9947f67b6251ece12323057a07f8cf8532643d7489c35fbecb5528846749ed7614bd', 'id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd/file', 'properties': {}}, 'image_service': } Jul 21 08:27:28 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Trying to clone 3a8dd6d7-da50-4186-8e0c-6decf909767f from image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}]). {{(pid=87372) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-c8bce578-0c9d-4343-bd9c-4587dd6c0454-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-c8bce578-0c9d-4343-bd9c-4587dd6c0454-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-c8bce578-0c9d-4343-bd9c-4587dd6c0454" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-c8bce578-0c9d-4343-bd9c-4587dd6c0454" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 21 08:27:29 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Image download 0.00 MB at 0.00 MB/s Jul 21 08:27:29 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bc00bc-ca6d-4a5d-b476-b1f64b72b54b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-17037a04-d389-4637-b666-aef37cfa690a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.366s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-17037a04-d389-4637-b666-aef37cfa690a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[562131d6-8878-489c-bb94-193cfbbca72e]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0676ba5-df89-4a1f-8d03-d4e690286ba0 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-1a0f1f19-d32d-42bd-b693-138469dd237c-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-17037a04-d389-4637-b666-aef37cfa690a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-17037a04-d389-4637-b666-aef37cfa690a" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:29 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 Jul 21 08:27:29 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e36183-4a51-4fd5-a0aa-5543e2530cd4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:29 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:29 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a Jul 21 08:27:29 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:29 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454" returned: 0 in 0.491s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:29 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454 Jul 21 08:27:29 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a" returned: 0 in 0.469s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:29 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:29 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:29 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a Jul 21 08:27:29 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:30 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c8bce578-0c9d-4343-bd9c-4587dd6c0454" returned: 0 in 0.378s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-c8bce578-0c9d-4343-bd9c-4587dd6c0454" released by "delete_volume" :: held 0.937s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['31b6c13a-c675-48ff-84d1-3433261d554b', '2501c53d-5cf2-491b-9fd8-faecb6a2c6a1', 'b474d027-0e0c-4423-8edf-d6cf472265e9', '1a7a31af-a7e7-424c-a4f1-4b31fe0ab670'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:30 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Temporary image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd is fetched for user 09b5c57feb634f8bab36d23f429e98eb. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 21 08:27:30 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-17037a04-d389-4637-b666-aef37cfa690a" returned: 0 in 0.317s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-17037a04-d389-4637-b666-aef37cfa690a" released by "delete_volume" :: held 0.859s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:30 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:30 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118bf61-b7df-4794-a3fc-0f303db34296]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['63bf3734-0c68-49ed-a934-f0cd1292475d', '4f89eacc-a2c5-4793-aab3-f91e4df9ae7d', '9ec87054-8af0-49ff-bca7-5067ba0574fe', 'd9e7420d-9270-4432-ba94-0a829ec3c271'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:30 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:30 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:30 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:30 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:30 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-26026912-0bff-41a9-9647-57a0fb5ead6f tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-c8bce578-0c9d-4343-bd9c-4587dd6c0454-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:30 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.304s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-08165f6c-bae5-4306-857e-d2483f42f08a tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-17037a04-d389-4637-b666-aef37cfa690a-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:30 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:30 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:30 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:31 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8dd6d7-da50-4186-8e0c-6decf909767f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea6c15aa24e4bce8e62d6355c3c19fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:28Z,use_quota=True,user_id='09b5c57feb634f8bab36d23f429e98eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Creating volume 3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:31 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:31 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1073741824 Jul 21 08:27:31 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-942e9ba0-8272-4908-91e1-d66815710fed-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-942e9ba0-8272-4908-91e1-d66815710fed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-942e9ba0-8272-4908-91e1-d66815710fed" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-942e9ba0-8272-4908-91e1-d66815710fed" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5797a7-f482-4b16-8606-ab5d775b1d8a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-d6f9530a-674a-4de0-9e06-b40b3e9b2aae-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-d6f9530a-674a-4de0-9e06-b40b3e9b2aae-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "cinder-quobyte-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:31 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed Jul 21 08:27:31 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" acquired by "delete_volume" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[337dc1fa-ef48-418b-af9c-b1052a625f8e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:31 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1073741824" returned: 0 in 0.563s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:31 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f Jul 21 08:27:31 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:31 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae Jul 21 08:27:31 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:31 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed" returned: 0 in 0.477s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:31 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed Jul 21 08:27:31 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Attempting download of 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd ((None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}])) to volume 3a8dd6d7-da50-4186-8e0c-6decf909767f. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 21 08:27:32 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" returned: 0 in 0.480s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[51549fe1-f4bb-4c8e-98b3-106bacd7ef11]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae Jul 21 08:27:32 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-942e9ba0-8272-4908-91e1-d66815710fed" returned: 0 in 0.286s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-942e9ba0-8272-4908-91e1-d66815710fed" released by "delete_volume" :: held 0.813s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['083618f8-8add-417e-8a4f-3489b851a1c5', '9fc981bb-fa89-4bfb-a08b-91c2944b779d', 'fce09d41-06a1-436b-b278-781760f6d71e', '36a4b6e3-2c27-4cea-b16d-9d37314e3117'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:32 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4 Jul 21 08:27:32 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:32 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-quobyte-d6f9530a-674a-4de0-9e06-b40b3e9b2aae" released by "delete_volume" :: held 0.828s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-e7b86f31-2bda-4c82-a693-244698134a7c-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:32 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Created reservations ['27a0a884-26d3-4f3b-8314-21bfb80fa6ec', '83632e81-2566-40d2-9935-938ba00ae7b6', '2e0f47bd-ae66-4143-9c12-775a7db83dd6', '5cdfc199-1ae8-46c0-b081-60a748f94165'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4" returned: 0 in 0.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-e7b86f31-2bda-4c82-a693-244698134a7c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-e7b86f31-2bda-4c82-a693-244698134a7c" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-e7b86f31-2bda-4c82-a693-244698134a7c" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:32 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:32 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4 Jul 21 08:27:32 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e779f7ce-e5f8-4552-a939-86ed7f3e576b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:32 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:32 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.487s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0599e95-6be1-47ca-a25f-51c8096a64ba tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-942e9ba0-8272-4908-91e1-d66815710fed-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:33 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c Jul 21 08:27:33 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.352s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:33 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Deleted volume successfully. Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-58684b74-780c-4732-95b0-4d488fc56d1e tempest-CreateVolumesFromSourceVolumeTest-606145485 None] Lock "cinder-d6f9530a-674a-4de0-9e06-b40b3e9b2aae-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:33 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4" returned: 1 in 0.639s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd__nogntw4' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb77a0a-f1cd-4c38-9b7a-3300782ff86d]: (4, 'raw') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Flow 'volume_create_manager' (6d5080e9-430e-42a5-b899-08592e1dbf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a50638-1a24-4c16-b0b5-09f26f37ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a50638-1a24-4c16-b0b5-09f26f37ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-989075230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6397b408-07de-4948-bc77-788c7b3c8f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef4c186dc1439eb3e05c99f70eea5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:33Z,use_quota=True,user_id='bb08ad5d5bcb4135b2c5b42eedd640ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bfe776-b455-45ec-8b07-0029e6b94ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bfe776-b455-45ec-8b07-0029e6b94ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984f06c-fa94-4662-83bb-64b1544def68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984f06c-fa94-4662-83bb-64b1544def68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6397b408-07de-4948-bc77-788c7b3c8f01', 'volume_name': 'volume-6397b408-07de-4948-bc77-788c7b3c8f01', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d765caa8-eace-4ea7-8921-bfe162b0b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:33 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d765caa8-eace-4ea7-8921-bfe162b0b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:33 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32d134-727b-4d0e-9f17-888da6bf7314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:33 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Volume 6397b408-07de-4948-bc77-788c7b3c8f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6397b408-07de-4948-bc77-788c7b3c8f01', 'volume_size': 1} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-989075230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6397b408-07de-4948-bc77-788c7b3c8f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef4c186dc1439eb3e05c99f70eea5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:33Z,use_quota=True,user_id='bb08ad5d5bcb4135b2c5b42eedd640ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Creating volume 6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:33 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:33 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c" returned: 0 in 0.588s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:33 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 1073741824 Jul 21 08:27:33 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c Jul 21 08:27:33 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:33 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e7b86f31-2bda-4c82-a693-244698134a7c" returned: 0 in 0.290s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-e7b86f31-2bda-4c82-a693-244698134a7c" released by "delete_volume" :: held 0.980s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:33 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD Jul 21 08:27:33 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['cdad6a8a-95d2-42e3-bad8-7dc12129c7be', 'a06e0bd3-cfbe-46db-914a-321a28933bc4', 'bdd30e37-3c25-44a4-ab9a-2a4efa3b51b8', 'cd61f5e5-6797-4841-a9f5-29a841dff09e'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:33 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:33 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:33 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 1073741824" returned: 0 in 0.599s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:34 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:34 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:34 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD" returned: 1 in 0.491s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd was raw, converting to qcow2 {{(pid=87372) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:34 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f Jul 21 08:27:34 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:34 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-31602225-07d5-4c1d-8915-f0dede0730bf tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-e7b86f31-2bda-4c82-a693-244698134a7c-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:34 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32d134-727b-4d0e-9f17-888da6bf7314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6397b408-07de-4948-bc77-788c7b3c8f01', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41712832-c23a-4092-89c6-386c97975428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Volume volume-6397b408-07de-4948-bc77-788c7b3c8f01 (6397b408-07de-4948-bc77-788c7b3c8f01): created successfully Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41712832-c23a-4092-89c6-386c97975428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Flow 'volume_create_manager' (6d5080e9-430e-42a5-b899-08592e1dbf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a2211e66-7d04-4050-838f-c3f2d12dd172 tempest-VolumeDependencyTests-2077146926 None] Created volume successfully. Jul 21 08:27:34 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f" returned: 0 in 0.565s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0852a9f5-ceb6-4b56-97fe-b5b5de9584fd_e81sbrv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:27:34 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Converted 0.00 MB image at 0.00 MB/s Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:34 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1G Jul 21 08:27:34 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-b89fff88-339e-42c0-9a60-c6c8d616fe7d-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-b89fff88-339e-42c0-9a60-c6c8d616fe7d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-b89fff88-339e-42c0-9a60-c6c8d616fe7d" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-b89fff88-339e-42c0-9a60-c6c8d616fe7d" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e89d83-e592-4d2f-aff9-20f6f4e9ecbf]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:35 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f 1G" returned: 0 in 0.388s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Downloaded image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd ((None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}])) to volume 3a8dd6d7-da50-4186-8e0c-6decf909767f successfully. {{(pid=87372) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Temporary image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd for user 09b5c57feb634f8bab36d23f429e98eb is deleted. {{(pid=87372) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.volume_utils [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Marking volume 3a8dd6d7-da50-4186-8e0c-6decf909767f as bootable. {{(pid=87372) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Copying metadata from image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd to 3a8dd6d7-da50-4186-8e0c-6decf909767f. {{(pid=87372) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Creating volume glance metadata for volume 3a8dd6d7-da50-4186-8e0c-6decf909767f backed by image 0852a9f5-ceb6-4b56-97fe-b5b5de9584fd with: {'image_id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '80ff61734aa421da797c479f2d8ecb7a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87372) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 21 08:27:35 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d Jul 21 08:27:35 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3436752-18cc-4007-8823-d31e17ab33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8dd6d7-da50-4186-8e0c-6decf909767f', 'volume_size': 1, 'image_id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80ff61734aa421da797c479f2d8ecb7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aea6c15aa24e4bce8e62d6355c3c19fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c812cea27dbad195ec3ed9ab5327c3e5768a3052af9f71aa1e90fe10047b9947f67b6251ece12323057a07f8cf8532643d7489c35fbecb5528846749ed7614bd', 'id': '0852a9f5-ceb6-4b56-97fe-b5b5de9584fd', 'created_at': datetime.datetime(2026, 7, 21, 6, 27, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 21, 6, 27, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0852a9f5-ceb6-4b56-97fe-b5b5de9584fd/file', 'properties': {}}, 'image_service': }' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a5672-eb99-4c4a-979d-1f86e0136518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Volume volume-3a8dd6d7-da50-4186-8e0c-6decf909767f (3a8dd6d7-da50-4186-8e0c-6decf909767f): created successfully Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a5672-eb99-4c4a-979d-1f86e0136518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Flow 'volume_create_manager' (e5611680-24de-4236-8cfc-8bd69e4593d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e175f80e-a030-463a-889f-23c57e06e337 tempest-VolumeImageDependencyTests-59513792 None] Created volume successfully. Jul 21 08:27:35 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:35 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d Jul 21 08:27:35 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Creating offline snapshot c8f7424f-fc33-42b5-ac47-3e92dc9d81fb of volume 6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5be975-85e3-414c-b344-9695c3618ff4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:35 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b89fff88-339e-42c0-9a60-c6c8d616fe7d" returned: 0 in 0.286s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-b89fff88-339e-42c0-9a60-c6c8d616fe7d" released by "delete_volume" :: held 0.759s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:35 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:35 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['1b0c7f10-2cc2-4537-8f27-5b4bec19913d', 'ee9c61f7-1d81-49e7-bf70-877709545c0e', '7983108f-31e4-4136-8e16-67ad62bac56f', '3f70feaa-0e01-4036-9dbe-4e6b5cfa8b17'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:35 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:35 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-c2a1e760-479e-4a2c-8955-bdadc42d7b44-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:36 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.471s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-c2a1e760-479e-4a2c-8955-bdadc42d7b44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:36 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.305s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:36 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:36 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb 1G Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-c2a1e760-479e-4a2c-8955-bdadc42d7b44" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:36 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Acquiring lock "cinder-3a8dd6d7-da50-4186-8e0c-6decf909767f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-c2a1e760-479e-4a2c-8955-bdadc42d7b44" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleting offline snapshot c2a1e760-479e-4a2c-8955-bdadc42d7b44 of volume fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] snapshot_file for this snap is: volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-63c55763-39d0-4c51-9d5b-dfb2e80d2f12 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-b89fff88-339e-42c0-9a60-c6c8d616fe7d-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "cinder-3a8dd6d7-da50-4186-8e0c-6decf909767f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6ee62c-5875-48db-8053-7bc3a3361c17]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Acquiring lock "cinder-quobyte-3a8dd6d7-da50-4186-8e0c-6decf909767f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "cinder-quobyte-3a8dd6d7-da50-4186-8e0c-6decf909767f" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[44580fde-939a-4c6e-a14c-5cb6b07ed6ab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 Jul 21 08:27:36 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f Jul 21 08:27:36 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:36 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44" returned: 0 in 0.428s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd034a04-05aa-4592-b693-14942e197db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb 1G" returned: 0 in 0.599s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6397b408-07de-4948-bc77-788c7b3c8f01 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce149b-391a-4d28-8012-92b8fc2fbb85]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6397b408-07de-4948-bc77-788c7b3c8f01 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:36 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f" returned: 0 in 0.467s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:36 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f Jul 21 08:27:36 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:36 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 Jul 21 08:27:36 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6397b408-07de-4948-bc77-788c7b3c8f01 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.323s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb is being set with open permissions: ugo+rw Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:37 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-3a8dd6d7-da50-4186-8e0c-6decf909767f" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "cinder-quobyte-3a8dd6d7-da50-4186-8e0c-6decf909767f" released by "delete_volume" :: held 0.813s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:37 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0" returned: 0 in 0.436s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 Jul 21 08:27:37 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Created reservations ['446ec337-dfe8-4d8f-bce6-26de6d522cef', '9c2311ca-3a48-4010-b6e5-2d995174480e', 'f9c9ddf1-e8c3-4452-9f7a-02607c23240a', '6fc43ff5-0569-4a6d-8027-6803629d4565'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:37 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.333s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info Jul 21 08:27:37 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44" returned: 0 in 0.486s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44 Jul 21 08:27:37 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:37 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Deleted volume successfully. Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-59e39ae7-50cc-4b3d-b5e8-58cb84f88abb tempest-VolumeImageDependencyTests-59513792 None] Lock "cinder-3a8dd6d7-da50-4186-8e0c-6decf909767f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:37 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info" returned: 0 in 0.436s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:37 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info is being set with open permissions: ugo+rw Jul 21 08:27:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:37 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info Jul 21 08:27:37 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:38 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0.c2a1e760-479e-4a2c-8955-bdadc42d7b44" returned: 0 in 0.340s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-c2a1e760-479e-4a2c-8955-bdadc42d7b44" released by "_delete_snapshot" :: held 1.859s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" released by "delete_snapshot" :: held 1.900s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:38 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.info" returned: 0 in 0.298s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['87e2af56-c289-4583-912b-742af614190d', 'a9a3e4ad-cd82-429f-be3c-aded198c5021', 'b1bba85a-3c99-467f-a819-1be4ad5e0f51', '900ba876-b547-4896-8048-310796232ec2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4818f594-36ac-423a-abc9-48617eb5e751 tempest-VolumeDependencyTests-2077146926 None] Create snapshot completed successfully Jul 21 08:27:38 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Delete snapshot completed successfully. Jul 21 08:27:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5b962dc1-1ef0-4575-b4a8-f97fb1e83751 tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-c2a1e760-479e-4a2c-8955-bdadc42d7b44-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-fd034a04-05aa-4592-b693-14942e197db0-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-fd034a04-05aa-4592-b693-14942e197db0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad0fa93-7b48-4258-8f6b-77f2eb63ada7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Flow 'volume_create_manager' (c3e69cca-75b2-4f4d-8711-9821ad3dd737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690f5fa3-509f-4dff-9770-f4679545b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690f5fa3-509f-4dff-9770-f4679545b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1796007494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548174b8-71c5-4e08-8ad1-57a55ef255ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afef4c186dc1439eb3e05c99f70eea5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8f7424f-fc33-42b5-ac47-3e92dc9d81fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:39Z,use_quota=True,user_id='bb08ad5d5bcb4135b2c5b42eedd640ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:39 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 Jul 21 08:27:39 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f370e21-b42a-4a4b-b41d-325ccc04e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f370e21-b42a-4a4b-b41d-325ccc04e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bf557-2b24-4990-a89a-4f88ac4db889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bf557-2b24-4990-a89a-4f88ac4db889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '548174b8-71c5-4e08-8ad1-57a55ef255ae', 'volume_name': 'volume-548174b8-71c5-4e08-8ad1-57a55ef255ae', 'volume_size': 1, 'snapshot_id': 'c8f7424f-fc33-42b5-ac47-3e92dc9d81fb'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec62867-0ddf-432e-879d-5bb428b1a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec62867-0ddf-432e-879d-5bb428b1a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86dce5d-756c-40af-a0aa-dd833ac2330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Volume 548174b8-71c5-4e08-8ad1-57a55ef255ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-548174b8-71c5-4e08-8ad1-57a55ef255ae', 'volume_size': 1, 'snapshot_id': 'c8f7424f-fc33-42b5-ac47-3e92dc9d81fb'} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-548174b8-71c5-4e08-8ad1-57a55ef255ae" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-548174b8-71c5-4e08-8ad1-57a55ef255ae" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Creating volume 548174b8-71c5-4e08-8ad1-57a55ef255ae from snapshot c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] snapshot: c8f7424f-fc33-42b5-ac47-3e92dc9d81fb, volume: 548174b8-71c5-4e08-8ad1-57a55ef255ae, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[198bcf33-3f10-4c6e-a9ce-cad459d7673e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:40 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:40 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:40 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0" returned: 0 in 0.595s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:40 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0 Jul 21 08:27:40 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:40 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6397b408-07de-4948-bc77-788c7b3c8f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92675a0-5d04-4329-8c40-6f47ffcb0cb4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:40 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:40 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:40 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fd034a04-05aa-4592-b693-14942e197db0" returned: 0 in 0.344s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-quobyte-fd034a04-05aa-4592-b693-14942e197db0" released by "delete_volume" :: held 1.036s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Created reservations ['6045191b-d357-49b4-9c43-0d21084beebc', 'bafeffc9-a301-49cb-889e-472c9940935c', 'a37e2417-e6f4-4700-b7e2-3d61a8c84964', '781d8d23-5fbe-40be-8a51-51cb874bda93'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:40 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:40 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:40 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:40 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae Jul 21 08:27:40 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:40 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.328s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:40 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Deleted volume successfully. Jul 21 08:27:41 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-fff9a6e0-c55f-4ece-84db-5e659d80a54d tempest-CreateVolumesFromSnapshotTest-1324821422 None] Lock "cinder-fd034a04-05aa-4592-b693-14942e197db0-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:42 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b201c5ff-e99c-4e9c-91e5-1dcb19bd5e2d tempest-ProjectAdminTests-583571150 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7322578430176, 'free_capacity_gb': 1775.7322578430176, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87372) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 21 08:27:46 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae" returned: 0 in 5.475s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebed4c-c11f-4413-952d-479449dcb0fa]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:46 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:46 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:46 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.651s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:27:46 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Converted 1024.00 MB image at 186.92 MB/s Jul 21 08:27:46 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae is being set with open permissions: ugo+rw Jul 21 08:27:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:47 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae Jul 21 08:27:47 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:47 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" released by "_copy_volume_from_snapshot" :: held 7.515s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-548174b8-71c5-4e08-8ad1-57a55ef255ae" released by "_create_volume_from_snapshot" :: held 7.567s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.589s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f86dce5d-756c-40af-a0aa-dd833ac2330e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548174b8-71c5-4e08-8ad1-57a55ef255ae', 'volume_size': 1, 'snapshot_id': 'c8f7424f-fc33-42b5-ac47-3e92dc9d81fb'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58ef5a1-5a43-4224-8f87-d6b29ac8837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:47 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Volume volume-548174b8-71c5-4e08-8ad1-57a55ef255ae (548174b8-71c5-4e08-8ad1-57a55ef255ae): created successfully Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58ef5a1-5a43-4224-8f87-d6b29ac8837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:47 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Flow 'volume_create_manager' (c3e69cca-75b2-4f4d-8711-9821ad3dd737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-740f3796-8520-4ed1-868c-a46505601710 tempest-VolumeDependencyTests-2077146926 None] Created volume successfully. Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Deleting offline snapshot c8f7424f-fc33-42b5-ac47-3e92dc9d81fb of volume 6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] snapshot_file for this snap is: volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebe323-bca8-4eba-a8d6-a81ee13e4e42]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:48 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:48 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:49 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.514s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6397b408-07de-4948-bc77-788c7b3c8f01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020532e-7e58-41f7-9e12-e67821d5f964]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:49 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:49 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Flow 'volume_create_manager' (1ab3b089-9d20-404a-9771-45af954f63a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a810a5e-84ac-4c3c-8825-ad8c4c20e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a810a5e-84ac-4c3c-8825-ad8c4c20e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d4bf5d-298e-405e-b7ac-02effdec2ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6e23b70c9546ff8fd3bdb4d8c08cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:49Z,use_quota=True,user_id='0373453b0c6b4da1850067049af88d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307ab909-e917-4c81-bebb-24f79933d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307ab909-e917-4c81-bebb-24f79933d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3a001f-8025-411b-97c4-2bbca2923574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf3a001f-8025-411b-97c4-2bbca2923574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d4bf5d-298e-405e-b7ac-02effdec2ebb', 'volume_name': 'volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6291ef0f-7c75-49e7-bd1f-b8c85594c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6291ef0f-7c75-49e7-bd1f-b8c85594c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8280b1d6-6f55-4a10-acac-9a754c42fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Volume d5d4bf5d-298e-405e-b7ac-02effdec2ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb', 'volume_size': 1} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d4bf5d-298e-405e-b7ac-02effdec2ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6e23b70c9546ff8fd3bdb4d8c08cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:49Z,use_quota=True,user_id='0373453b0c6b4da1850067049af88d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Creating volume d5d4bf5d-298e-405e-b7ac-02effdec2ebb {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:49 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:49 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb 1073741824 Jul 21 08:27:49 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:49 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.507s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:49 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:49 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:50 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.454s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:50 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb 1073741824" returned: 0 in 0.583s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:50 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb Jul 21 08:27:50 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:50 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb Jul 21 08:27:50 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:50 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01.c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" returned: 0 in 0.374s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:50 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" returned: 0 in 0.351s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb" released by "_delete_snapshot" :: held 2.007s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8280b1d6-6f55-4a10-acac-9a754c42fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c0ceb1-9a61-453a-91ff-118430ec7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" released by "delete_snapshot" :: held 2.055s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:50 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Volume volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb (d5d4bf5d-298e-405e-b7ac-02effdec2ebb): created successfully Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c0ceb1-9a61-453a-91ff-118430ec7e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Flow 'volume_create_manager' (1ab3b089-9d20-404a-9771-45af954f63a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3879b7e5-00ef-455c-90b6-5437ae09bdc0 tempest-CinderUnicodeTest-1161878278 None] Created volume successfully. Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Created reservations ['7d615438-27fd-4f3d-a419-4d6e8281bc60', 'c777a91c-1d0a-4f15-b620-e84760ac405d', 'c7075171-4fb3-4314-a23c-c1a48e20aec1', '6ffdb994-7282-44e0-ae00-19f778b9244d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Delete snapshot completed successfully. Jul 21 08:27:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c01857a7-8448-4de2-841d-b276ca4dbeae tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-c8f7424f-fc33-42b5-ac47-3e92dc9d81fb-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-6397b408-07de-4948-bc77-788c7b3c8f01-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-6397b408-07de-4948-bc77-788c7b3c8f01-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe86e8-0019-402a-8e97-40259e157eab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:51 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:51 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Flow 'volume_create_manager' (82de5ab5-0757-44ad-b151-fbbbb0764cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f397e4c-7d30-40c7-ae49-0b4c78506e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f397e4c-7d30-40c7-ae49-0b4c78506e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518367509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbb6909-1998-464e-a5a9-90fb842e807e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6e23b70c9546ff8fd3bdb4d8c08cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:52Z,use_quota=True,user_id='0373453b0c6b4da1850067049af88d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de751bd-3de1-48d0-91b5-3d1a9669007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de751bd-3de1-48d0-91b5-3d1a9669007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303c1e36-89ff-42bf-8d4a-1cfd066cc1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (303c1e36-89ff-42bf-8d4a-1cfd066cc1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbb6909-1998-464e-a5a9-90fb842e807e', 'volume_name': 'volume-0cbb6909-1998-464e-a5a9-90fb842e807e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a9a5d6-b7a6-4e10-85b6-2c585fb1340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a9a5d6-b7a6-4e10-85b6-2c585fb1340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0086453-f82c-4ad8-aa49-589b3b6a109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:52 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Volume 0cbb6909-1998-464e-a5a9-90fb842e807e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbb6909-1998-464e-a5a9-90fb842e807e', 'volume_size': 1} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:27:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1518367509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbb6909-1998-464e-a5a9-90fb842e807e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d6e23b70c9546ff8fd3bdb4d8c08cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:27:52Z,use_quota=True,user_id='0373453b0c6b4da1850067049af88d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Creating volume 0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:27:52 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:52 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.473s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:52 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e 1073741824 Jul 21 08:27:52 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:52 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01 Jul 21 08:27:52 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:52 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6397b408-07de-4948-bc77-788c7b3c8f01" returned: 0 in 0.350s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-6397b408-07de-4948-bc77-788c7b3c8f01" released by "delete_volume" :: held 0.953s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:52 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:52 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Created reservations ['28c4a18c-1a7a-4e63-bf31-83c2a6c8f1a2', 'a7e94f05-ea73-4815-849c-e486a90c4fe8', '838e5267-cce2-40aa-ae01-efcbe49dfb88', '45864bcc-c596-4a00-a614-a5cfc1e27248'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:52 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e 1073741824" returned: 0 in 0.652s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:52 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:53 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:53 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e Jul 21 08:27:53 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:53 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.414s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:27:53 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.333s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Deleted volume successfully. Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ed080230-3f22-41aa-9dee-da063f4bb471 tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-6397b408-07de-4948-bc77-788c7b3c8f01-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:53 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e" returned: 0 in 0.366s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0086453-f82c-4ad8-aa49-589b3b6a109f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbb6909-1998-464e-a5a9-90fb842e807e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8908d39a-271b-44c1-b3a4-7f07ec93a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:27:53 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Volume volume-0cbb6909-1998-464e-a5a9-90fb842e807e (0cbb6909-1998-464e-a5a9-90fb842e807e): created successfully Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8908d39a-271b-44c1-b3a4-7f07ec93a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Flow 'volume_create_manager' (82de5ab5-0757-44ad-b151-fbbbb0764cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:27:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-32d5fd03-f09a-44af-82b0-ad04564b4177 tempest-CinderUnicodeTest-1161878278 None] Created volume successfully. Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-548174b8-71c5-4e08-8ad1-57a55ef255ae-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-548174b8-71c5-4e08-8ad1-57a55ef255ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e3345-8ec0-4e37-a253-2747a1dfeaaf]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:54 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae Jul 21 08:27:54 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:54 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:54 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae Jul 21 08:27:54 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Creating offline snapshot 9e86b4db-c4ba-4026-a4fb-e218e2ab4768 of volume 0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ab50a-7f24-4a33-84a8-48f4e05e4417]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:54 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e Jul 21 08:27:54 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:54 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-548174b8-71c5-4e08-8ad1-57a55ef255ae" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-quobyte-548174b8-71c5-4e08-8ad1-57a55ef255ae" released by "delete_volume" :: held 0.759s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Created reservations ['7f065fdb-4e32-428f-ab1b-323c40d07f10', '3ee09925-cc66-4462-b45e-071a8753cb0f', '359e1dd6-88aa-4b52-86e3-40a8e0a2cd77', 'fca9ef51-4cf5-4af1-9f4f-9e0767b74f60'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:54 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:27:54 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:55 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e" returned: 0 in 0.493s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:55 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 1G Jul 21 08:27:55 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:55 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.300s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:27:55 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Deleted volume successfully. Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-ef836384-888c-4be3-aacc-4a95f505643c tempest-VolumeDependencyTests-2077146926 None] Lock "cinder-548174b8-71c5-4e08-8ad1-57a55ef255ae-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:55 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 1G" returned: 0 in 0.547s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbb6909-1998-464e-a5a9-90fb842e807e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:55 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbb6909-1998-464e-a5a9-90fb842e807e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 Jul 21 08:27:55 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:55 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cbb6909-1998-464e-a5a9-90fb842e807e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768" returned: 0 in 0.372s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:55 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 is being set with open permissions: ugo+rw Jul 21 08:27:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:55 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 Jul 21 08:27:55 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:56 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:56 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info Jul 21 08:27:56 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:56 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info" returned: 0 in 0.298s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:56 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info is being set with open permissions: ugo+rw Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:56 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info Jul 21 08:27:56 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:56 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.info" returned: 0 in 0.341s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:27:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5ee83176-7514-4e95-a971-3ab3570e61e2 tempest-CinderUnicodeTest-1161878278 None] Create snapshot completed successfully Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-9e86b4db-c4ba-4026-a4fb-e218e2ab4768-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-9e86b4db-c4ba-4026-a4fb-e218e2ab4768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-quobyte-9e86b4db-c4ba-4026-a4fb-e218e2ab4768" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-9e86b4db-c4ba-4026-a4fb-e218e2ab4768" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Deleting offline snapshot 9e86b4db-c4ba-4026-a4fb-e218e2ab4768 of volume 0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] snapshot_file for this snap is: volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c1ba6-ed9e-4f35-b476-6a827e89b2e0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:57 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 Jul 21 08:27:57 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:58 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768" returned: 0 in 0.446s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cbb6909-1998-464e-a5a9-90fb842e807e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad69de3-5a2a-4458-8f88-e7eaefa00034]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:58 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e Jul 21 08:27:58 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:58 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e" returned: 0 in 0.478s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:58 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 Jul 21 08:27:58 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:59 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:27:59 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768 Jul 21 08:27:59 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:27:59 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e.9e86b4db-c4ba-4026-a4fb-e218e2ab4768" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:UPDATE=240,cinder:SELECT=194,cinder:INSERT=66,cinder:DELETE=23 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=177,cinder:UPDATE=269,cinder:INSERT=70,cinder:DELETE=24 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-9e86b4db-c4ba-4026-a4fb-e218e2ab4768" released by "_delete_snapshot" :: held 1.704s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" released by "delete_snapshot" :: held 1.749s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Created reservations ['7fc5b5f5-ce99-47ee-9277-a5d5aa749a31', '1ff2e29f-243d-47ec-bf98-a23aa142998a', '6a5ab072-98bd-4f0d-963e-05150a29d011', '48038ff8-1d74-4d0c-974e-d260d8597b05'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:27:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Delete snapshot completed successfully. Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-25e4ac37-5135-4a3c-a10e-0d88dfe79294 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-9e86b4db-c4ba-4026-a4fb-e218e2ab4768-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-0cbb6909-1998-464e-a5a9-90fb842e807e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-0cbb6909-1998-464e-a5a9-90fb842e807e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:27:59 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" acquired by "delete_volume" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[347cc757-5ad4-433f-8a17-44a675daee8c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:00 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e Jul 21 08:28:00 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:00 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e" returned: 0 in 0.437s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:00 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e Jul 21 08:28:00 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (f623a72a-f785-4365-8d08-27fc840d6dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a34c21-39c2-4271-871d-a3dc80c7d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a34c21-39c2-4271-871d-a3dc80c7d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269734280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89889dbf-0804-4a60-95e6-b3464fd89890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:01Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e86b0e-c853-46b3-b27c-64d4c3972178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e86b0e-c853-46b3-b27c-64d4c3972178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a0d671-4e9e-450a-967f-3a6300f6424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a0d671-4e9e-450a-967f-3a6300f6424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89889dbf-0804-4a60-95e6-b3464fd89890', 'volume_name': 'volume-89889dbf-0804-4a60-95e6-b3464fd89890', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e658b8-4379-4242-887f-1153dca5e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e658b8-4379-4242-887f-1153dca5e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e66221-b40a-4ee0-b0f0-8f595bd33275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:00 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Volume 89889dbf-0804-4a60-95e6-b3464fd89890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89889dbf-0804-4a60-95e6-b3464fd89890', 'volume_size': 1} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269734280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89889dbf-0804-4a60-95e6-b3464fd89890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:01Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Creating volume 89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:00 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:00 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 1073741824 Jul 21 08:28:00 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:00 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-0cbb6909-1998-464e-a5a9-90fb842e807e" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-0cbb6909-1998-464e-a5a9-90fb842e807e" released by "delete_volume" :: held 0.857s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:00 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Created reservations ['cb8358c4-2736-43cd-9896-c59ca538ec7b', 'd5d255cd-6cb4-40b4-bff5-7c1720bc1849', '1d1ea3e6-5006-4040-88b1-233a0bd64f78', '2edc56a8-a037-4542-94ad-a5b7fad7e93c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:01 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:01 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-d5d4bf5d-298e-405e-b7ac-02effdec2ebb-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-d5d4bf5d-298e-405e-b7ac-02effdec2ebb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "cinder-quobyte-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" acquired by "delete_volume" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f997b88-a3ba-4dae-a51b-ecd01f87de61]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:01 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 1073741824" returned: 0 in 0.676s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:01 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb Jul 21 08:28:01 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:01 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:01 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 Jul 21 08:28:01 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.414s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Deleted volume successfully. Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2a5d4fc2-6a81-4861-a0ae-ff5c8bb46ac1 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-0cbb6909-1998-464e-a5a9-90fb842e807e-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:01 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890" returned: 0 in 0.334s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e66221-b40a-4ee0-b0f0-8f595bd33275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89889dbf-0804-4a60-95e6-b3464fd89890', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab63da-98b8-416e-9d5a-78aaf1169ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:01 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:01 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Volume volume-89889dbf-0804-4a60-95e6-b3464fd89890 (89889dbf-0804-4a60-95e6-b3464fd89890): created successfully Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab63da-98b8-416e-9d5a-78aaf1169ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (f623a72a-f785-4365-8d08-27fc840d6dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:01 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb Jul 21 08:28:01 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:01 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bfa97767-f8be-47a4-a44d-d49b18ecff17 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:02 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-quobyte-d5d4bf5d-298e-405e-b7ac-02effdec2ebb" released by "delete_volume" :: held 0.846s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Created reservations ['783cae57-3124-46bb-9bed-02b12f203db0', '706508f2-8694-43b9-91be-b1ff6c451050', '83e96d2c-3dec-420f-a46f-72e42d8896f8', 'f882daa9-338c-46bf-a5de-b6f0b854d4dd'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:02 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:02 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:02 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.280s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:02 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Deleted volume successfully. Jul 21 08:28:02 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0b46322e-c1d9-4156-960b-68ad67cccf49 tempest-CinderUnicodeTest-1161878278 None] Lock "cinder-d5d4bf5d-298e-405e-b7ac-02effdec2ebb-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Creating offline snapshot fe43744a-2412-44c7-a7e4-ea4e74dd6446 of volume 89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fefc6c-789d-4a23-9ee0-521f47f7ce3e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:03 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 Jul 21 08:28:03 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:03 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890" returned: 0 in 0.519s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:04 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 1G Jul 21 08:28:04 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:04 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 1G" returned: 0 in 0.614s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89889dbf-0804-4a60-95e6-b3464fd89890 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:04 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89889dbf-0804-4a60-95e6-b3464fd89890 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 Jul 21 08:28:04 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:04 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89889dbf-0804-4a60-95e6-b3464fd89890 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:04 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 is being set with open permissions: ugo+rw Jul 21 08:28:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:04 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 Jul 21 08:28:05 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:05 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:05 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info Jul 21 08:28:05 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:05 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:05 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info is being set with open permissions: ugo+rw Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:05 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info Jul 21 08:28:05 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:05 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.info" returned: 0 in 0.295s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:05 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e0581e49-f0ef-443a-a930-b985586b0646 tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-fe43744a-2412-44c7-a7e4-ea4e74dd6446-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-fe43744a-2412-44c7-a7e4-ea4e74dd6446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-fe43744a-2412-44c7-a7e4-ea4e74dd6446" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fe43744a-2412-44c7-a7e4-ea4e74dd6446" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot fe43744a-2412-44c7-a7e4-ea4e74dd6446 of volume 89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6d67e-3649-4c7d-9140-fb8a17e0a95e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:06 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:06 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (511987aa-d59b-4383-a98b-b5640392b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2680d6f6-8777-4051-baf8-55dd533cbaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2680d6f6-8777-4051-baf8-55dd533cbaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824844361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766606af-0ccd-402a-88ea-cec4e8f785f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:07Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79397417-87bb-4ac2-bb20-cda0d91e4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79397417-87bb-4ac2-bb20-cda0d91e4976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd0cf8-7d67-44c3-a532-60f738cc5ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cd0cf8-7d67-44c3-a532-60f738cc5ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766606af-0ccd-402a-88ea-cec4e8f785f9', 'volume_name': 'volume-766606af-0ccd-402a-88ea-cec4e8f785f9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693f8bc1-6a6e-4734-be53-be1af58d332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (693f8bc1-6a6e-4734-be53-be1af58d332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a93e61-8289-462a-8470-3e24c47c4a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:06 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Volume 766606af-0ccd-402a-88ea-cec4e8f785f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766606af-0ccd-402a-88ea-cec4e8f785f9', 'volume_size': 1} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824844361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766606af-0ccd-402a-88ea-cec4e8f785f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:07Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Creating volume 766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:06 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:06 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 1073741824 Jul 21 08:28:06 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:07 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446" returned: 0 in 0.420s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89889dbf-0804-4a60-95e6-b3464fd89890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8976a0-a6c3-4c1f-b46b-9efcb69ab7ca]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:07 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 Jul 21 08:28:07 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:07 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 1073741824" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:07 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 Jul 21 08:28:07 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:07 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890" returned: 0 in 0.414s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:07 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 Jul 21 08:28:07 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:07 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9" returned: 0 in 0.338s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a93e61-8289-462a-8470-3e24c47c4a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766606af-0ccd-402a-88ea-cec4e8f785f9', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a26b591-b8d2-4a3c-b3a5-af565df2b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:07 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Volume volume-766606af-0ccd-402a-88ea-cec4e8f785f9 (766606af-0ccd-402a-88ea-cec4e8f785f9): created successfully Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a26b591-b8d2-4a3c-b3a5-af565df2b274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (511987aa-d59b-4383-a98b-b5640392b148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-da08685f-e20d-4097-bff5-7407d6f00dc4 tempest-ProjectReaderTests-488337387 None] Created volume successfully. Jul 21 08:28:07 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446" returned: 0 in 0.421s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:07 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446 Jul 21 08:28:07 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:08 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890.fe43744a-2412-44c7-a7e4-ea4e74dd6446" returned: 0 in 0.245s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fe43744a-2412-44c7-a7e4-ea4e74dd6446" released by "_delete_snapshot" :: held 1.634s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" released by "delete_snapshot" :: held 1.668s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Created reservations ['591c02e7-ebd2-43b1-8fb0-a464d2c6f70a', '6d807534-5b53-413d-ae77-6e1a9a8eb9d3', '600d7920-d848-465f-9fa8-b9b2daebede0', '337f57d3-fcc7-4f66-8135-11ae88ab7922'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:08 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-910452cf-6f70-420b-b11b-e16e027fd50d tempest-ProjectMemberTests-159017781 None] Lock "cinder-fe43744a-2412-44c7-a7e4-ea4e74dd6446-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-89889dbf-0804-4a60-95e6-b3464fd89890-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "cinder-89889dbf-0804-4a60-95e6-b3464fd89890-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57ff775-cddd-4664-94c9-32385dca57b7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:08 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 Jul 21 08:28:08 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Creating offline snapshot 0cbebc69-2ee9-4fbd-993b-6a876cb49664 of volume 766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc65ee1-3756-462c-8f34-4ed2974b83f5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:09 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 Jul 21 08:28:09 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:09 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:09 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890 Jul 21 08:28:09 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:09 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9" returned: 0 in 0.393s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:09 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-89889dbf-0804-4a60-95e6-b3464fd89890" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:09 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 1G Jul 21 08:28:09 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-89889dbf-0804-4a60-95e6-b3464fd89890" released by "delete_volume" :: held 0.767s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Created reservations ['eb9587ad-4ba7-46da-9bd3-2704f62145b1', '1d37a1c8-423c-4853-907f-f21e3d65d993', '2522cc11-37fa-4c76-995d-5d8795d90f01', 'c03a3f51-e5b3-493b-a383-e8103f9a06ac'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:09 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:09 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:09 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.303s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:09 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:09 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 1G" returned: 0 in 0.490s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766606af-0ccd-402a-88ea-cec4e8f785f9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b52abc6a-e065-42f6-abc5-23a927981b83 tempest-ProjectMemberTests-159017781 None] Lock "cinder-89889dbf-0804-4a60-95e6-b3464fd89890-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:10 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766606af-0ccd-402a-88ea-cec4e8f785f9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 Jul 21 08:28:10 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (8c1f5b3b-3629-4106-8741-6b178d7537da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb0403a-d22f-478a-9ff1-dfa76d1eaf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb0403a-d22f-478a-9ff1-dfa76d1eaf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448789919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28be841c-ca5e-40d2-a61c-2efc47cba8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:10Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc73dc7f-fb7a-4943-b4a7-31ac31858e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc73dc7f-fb7a-4943-b4a7-31ac31858e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946162a3-ad1a-4f79-bfc4-f639caad9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946162a3-ad1a-4f79-bfc4-f639caad9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28be841c-ca5e-40d2-a61c-2efc47cba8f4', 'volume_name': 'volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31138d6-4ba3-491f-9928-5b8bc588806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31138d6-4ba3-491f-9928-5b8bc588806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d14080-2eeb-4657-b188-c324d5da8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Volume 28be841c-ca5e-40d2-a61c-2efc47cba8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4', 'volume_size': 1} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:10 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766606af-0ccd-402a-88ea-cec4e8f785f9 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664" returned: 0 in 0.367s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:10 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 is being set with open permissions: ugo+rw Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:10 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 Jul 21 08:28:10 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (8b0b4252-315d-4a2a-b77d-66ecf9e90040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626e9429-aaaa-4d46-a0ba-4d20750e210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626e9429-aaaa-4d46-a0ba-4d20750e210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624641979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb8bb12-2495-4864-b367-f83475a756ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:10Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df44cd33-f92a-405c-8e03-9f387c258990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df44cd33-f92a-405c-8e03-9f387c258990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a9b0fd-8239-4617-8d7e-e4bdb68034d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a9b0fd-8239-4617-8d7e-e4bdb68034d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb8bb12-2495-4864-b367-f83475a756ba', 'volume_name': 'volume-5eb8bb12-2495-4864-b367-f83475a756ba', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da13ef52-d2f5-4777-9bb1-5f1fb4ec80e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da13ef52-d2f5-4777-9bb1-5f1fb4ec80e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0185c6d1-4962-433d-96cd-d0187b643c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Volume 5eb8bb12-2495-4864-b367-f83475a756ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb8bb12-2495-4864-b367-f83475a756ba', 'volume_size': 1} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:10 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664" returned: 0 in 0.242s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:10 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info Jul 21 08:28:10 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:10 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info" returned: 0 in 0.252s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:10 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info is being set with open permissions: ugo+rw Jul 21 08:28:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:10 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info Jul 21 08:28:10 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:11 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.info" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448789919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28be841c-ca5e-40d2-a61c-2efc47cba8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:10Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Creating volume 28be841c-ca5e-40d2-a61c-2efc47cba8f4 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:11 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 1073741824 Jul 21 08:28:11 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5f22a373-4cc4-462b-936d-630d7dc10353 tempest-ProjectReaderTests-488337387 None] Create snapshot completed successfully Jul 21 08:28:11 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 1073741824" returned: 0 in 0.403s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:11 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 Jul 21 08:28:11 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:11 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624641979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb8bb12-2495-4864-b367-f83475a756ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:10Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Creating volume 5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d14080-2eeb-4657-b188-c324d5da8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf9d36-3c00-40ef-a2f0-3e6fa87e60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:11 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba 1073741824 Jul 21 08:28:11 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Volume volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 (28be841c-ca5e-40d2-a61c-2efc47cba8f4): created successfully Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf9d36-3c00-40ef-a2f0-3e6fa87e60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (8c1f5b3b-3629-4106-8741-6b178d7537da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:11 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1c078f67-9abf-4fe9-9c67-d8646cce31e9 tempest-ProjectReaderTests-831859969 None] Created volume successfully. Jul 21 08:28:12 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba 1073741824" returned: 0 in 0.438s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:12 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba Jul 21 08:28:12 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-28be841c-ca5e-40d2-a61c-2efc47cba8f4-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-0cbebc69-2ee9-4fbd-993b-6a876cb49664-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "cinder-28be841c-ca5e-40d2-a61c-2efc47cba8f4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-0cbebc69-2ee9-4fbd-993b-6a876cb49664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-0cbebc69-2ee9-4fbd-993b-6a876cb49664" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-quobyte-28be841c-ca5e-40d2-a61c-2efc47cba8f4" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-0cbebc69-2ee9-4fbd-993b-6a876cb49664" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Deleting offline snapshot 0cbebc69-2ee9-4fbd-993b-6a876cb49664 of volume 766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] snapshot_file for this snap is: volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-28be841c-ca5e-40d2-a61c-2efc47cba8f4" acquired by "delete_volume" :: waited 0.037s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbc4f9-39d6-4d5b-8550-4bdd985ce8ff]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18065a7-bb83-476d-970d-51c1f46121e0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:12 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba" returned: 0 in 0.283s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0185c6d1-4962-433d-96cd-d0187b643c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb8bb12-2495-4864-b367-f83475a756ba', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ad143-9116-4231-a33e-a6319e6f4e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Volume volume-5eb8bb12-2495-4864-b367-f83475a756ba (5eb8bb12-2495-4864-b367-f83475a756ba): created successfully Jul 21 08:28:12 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ad143-9116-4231-a33e-a6319e6f4e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:12 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:12 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 Jul 21 08:28:12 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (8b0b4252-315d-4a2a-b77d-66ecf9e90040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bd8cb950-1001-4db0-b03b-c04c905683f2 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:12 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:12 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664" returned: 0 in 0.395s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-766606af-0ccd-402a-88ea-cec4e8f785f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:12 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4 Jul 21 08:28:12 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb309cd8-4942-47bf-b2d5-9132499d0310]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:13 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 Jul 21 08:28:13 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:13 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28be841c-ca5e-40d2-a61c-2efc47cba8f4" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-28be841c-ca5e-40d2-a61c-2efc47cba8f4" released by "delete_volume" :: held 0.663s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Created reservations ['cdddf9a1-fe3c-469c-8572-81a1bddcb505', 'd43cefd2-98ae-4d77-9405-205ae29042c3', '49e2a333-641d-408f-a4f4-374a01758820', '2ad037ad-b76f-4077-bf18-4275c94f8d41'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:13 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:13 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:13 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9" returned: 0 in 0.361s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:13 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 Jul 21 08:28:13 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:13 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.249s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:13 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Deleted volume successfully. Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-71d2442e-9f4c-49b5-ab38-c0b4f50124b8 tempest-ProjectReaderTests-831859969 None] Lock "cinder-28be841c-ca5e-40d2-a61c-2efc47cba8f4-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:13 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664" returned: 0 in 0.379s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:13 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664 Jul 21 08:28:13 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Creating offline snapshot cc3261e0-dad5-4b64-a9b3-6ab1cef53264 of volume 5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6420b2-ba00-4772-be8a-d793c906c84c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:13 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9.0cbebc69-2ee9-4fbd-993b-6a876cb49664" returned: 0 in 0.285s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:13 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba Jul 21 08:28:13 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-0cbebc69-2ee9-4fbd-993b-6a876cb49664" released by "_delete_snapshot" :: held 1.528s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" released by "delete_snapshot" :: held 1.571s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Created reservations ['22b486d0-11fb-4c7f-a79c-4fde012c69f6', 'e67d91cb-f7b5-45d1-84c8-e3db9189ddff', '7ad0059b-86a9-4613-ab6e-03052a585b0e', '9b8ff495-51c4-4099-aac7-ca200a23ffb3'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Delete snapshot completed successfully. Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-eaef792c-f6b1-4bb5-9b80-00c896addc63 tempest-ProjectReaderTests-488337387 None] Lock "cinder-0cbebc69-2ee9-4fbd-993b-6a876cb49664-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:14 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba" returned: 0 in 0.413s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:14 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 1G Jul 21 08:28:14 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (dae53b2b-86dd-44bb-9737-112f27572001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd054a6e-6d00-4836-9493-92046cec6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd054a6e-6d00-4836-9493-92046cec6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234463553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28915260-9cfa-4d19-9982-10752a57b658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:14Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd180a2-edbe-471f-ae39-b449c26baae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd180a2-edbe-471f-ae39-b449c26baae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae3e9de-6079-458c-9bfc-94bca76f29c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae3e9de-6079-458c-9bfc-94bca76f29c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28915260-9cfa-4d19-9982-10752a57b658', 'volume_name': 'volume-28915260-9cfa-4d19-9982-10752a57b658', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f24add-0850-4fb5-a35d-14f08f843ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f24add-0850-4fb5-a35d-14f08f843ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cfdb74-4d00-4d47-8a43-b4a4b657b3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Volume 28915260-9cfa-4d19-9982-10752a57b658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28915260-9cfa-4d19-9982-10752a57b658', 'volume_size': 1} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-766606af-0ccd-402a-88ea-cec4e8f785f9-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "cinder-766606af-0ccd-402a-88ea-cec4e8f785f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c3b49-e83e-46ff-861e-5f040ab2fd33]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:14 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 1G" returned: 0 in 0.427s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8bb12-2495-4864-b367-f83475a756ba -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:14 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8bb12-2495-4864-b367-f83475a756ba -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 Jul 21 08:28:14 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:14 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 Jul 21 08:28:14 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5eb8bb12-2495-4864-b367-f83475a756ba -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 is being set with open permissions: ugo+rw Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9" returned: 0 in 0.368s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 Jul 21 08:28:15 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9 Jul 21 08:28:15 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264" returned: 0 in 0.256s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-766606af-0ccd-402a-88ea-cec4e8f785f9" returned: 0 in 0.252s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-766606af-0ccd-402a-88ea-cec4e8f785f9" released by "delete_volume" :: held 0.693s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:15 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info Jul 21 08:28:15 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Created reservations ['951af907-3ff1-4cb8-9e88-fe81cbdad4a9', 'fe24888f-9e7e-49ff-9c01-9542945f8783', 'e5bd5190-eacb-4c01-8472-1bd9da5f261e', 'b18be087-9fd7-4afc-a790-b7ce171425a7'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:15 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info" returned: 0 in 0.249s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info is being set with open permissions: ugo+rw Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info Jul 21 08:28:15 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Deleted volume successfully. Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c7b6bfeb-7c6d-40cb-9f08-9d3541a9a759 tempest-ProjectReaderTests-488337387 None] Lock "cinder-766606af-0ccd-402a-88ea-cec4e8f785f9-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:15 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.info" returned: 0 in 0.263s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1234463553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28915260-9cfa-4d19-9982-10752a57b658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:14Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Creating volume 28915260-9cfa-4d19-9982-10752a57b658 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:15 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:15 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 1073741824 Jul 21 08:28:15 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cee50573-ce95-4b91-9499-47c1d09f097c tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (8e8f4ff0-29e0-4c27-9baf-85d39e443feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35ad21e-4d89-445a-8ffd-e034aec8bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35ad21e-4d89-445a-8ffd-e034aec8bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839161530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001f457a-8c78-4bd7-bfbb-adb4028ca413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:16Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2717c3-4945-4fe3-91b0-dac674f77a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2717c3-4945-4fe3-91b0-dac674f77a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9c2284-d710-4731-85b4-943f2b11fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9c2284-d710-4731-85b4-943f2b11fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001f457a-8c78-4bd7-bfbb-adb4028ca413', 'volume_name': 'volume-001f457a-8c78-4bd7-bfbb-adb4028ca413', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1f41b4-a902-416c-a0ca-1bf2ad94af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1f41b4-a902-416c-a0ca-1bf2ad94af05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767cc5e-52d7-4cd7-a898-aff6a2c31571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Volume 001f457a-8c78-4bd7-bfbb-adb4028ca413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001f457a-8c78-4bd7-bfbb-adb4028ca413', 'volume_size': 1} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:16 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 1073741824" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:16 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 Jul 21 08:28:16 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:16 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658" returned: 0 in 0.234s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839161530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001f457a-8c78-4bd7-bfbb-adb4028ca413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:16Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Creating volume 001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:16 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:16 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 1073741824 Jul 21 08:28:16 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cfdb74-4d00-4d47-8a43-b4a4b657b3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28915260-9cfa-4d19-9982-10752a57b658', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8818e4-f775-49c8-8508-b8bea75bc2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:16 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Volume volume-28915260-9cfa-4d19-9982-10752a57b658 (28915260-9cfa-4d19-9982-10752a57b658): created successfully Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8818e4-f775-49c8-8508-b8bea75bc2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (dae53b2b-86dd-44bb-9737-112f27572001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-f0a55d46-c14d-4df2-8049-5016e6820138 tempest-ProjectReaderTests-831859969 None] Created volume successfully. Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-cc3261e0-dad5-4b64-a9b3-6ab1cef53264-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-cc3261e0-dad5-4b64-a9b3-6ab1cef53264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-cc3261e0-dad5-4b64-a9b3-6ab1cef53264" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-cc3261e0-dad5-4b64-a9b3-6ab1cef53264" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot cc3261e0-dad5-4b64-a9b3-6ab1cef53264 of volume 5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:17 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 1073741824" returned: 0 in 0.455s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fcc16-5a52-4146-abd9-709caa4545d3]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:17 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 Jul 21 08:28:17 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:17 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 Jul 21 08:28:17 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:17 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413" returned: 0 in 0.252s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1767cc5e-52d7-4cd7-a898-aff6a2c31571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001f457a-8c78-4bd7-bfbb-adb4028ca413', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9a6b3f-0e37-4791-8e0e-094de3ce017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:17 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Volume volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 (001f457a-8c78-4bd7-bfbb-adb4028ca413): created successfully Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9a6b3f-0e37-4791-8e0e-094de3ce017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (8e8f4ff0-29e0-4c27-9baf-85d39e443feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:17 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-ab4d89e7-ff2b-4730-8f6e-dc7aebae99b1 tempest-ProjectReaderTests-488337387 None] Created volume successfully. Jul 21 08:28:17 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264" returned: 0 in 0.378s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eb8bb12-2495-4864-b367-f83475a756ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebb758-6c8e-4452-855f-260177c55960]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-28915260-9cfa-4d19-9982-10752a57b658-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "cinder-28915260-9cfa-4d19-9982-10752a57b658-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-quobyte-28915260-9cfa-4d19-9982-10752a57b658" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:17 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba Jul 21 08:28:17 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-28915260-9cfa-4d19-9982-10752a57b658" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7dc1a-1564-4efd-abd9-f5a4a7ae86bb]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:17 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 Jul 21 08:28:17 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:17 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba" returned: 0 in 0.400s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:17 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 Jul 21 08:28:17 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:17 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658" returned: 0 in 0.386s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:18 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658 Jul 21 08:28:18 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:18 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264" returned: 0 in 0.381s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:18 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-28915260-9cfa-4d19-9982-10752a57b658" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:18 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264 Jul 21 08:28:18 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-28915260-9cfa-4d19-9982-10752a57b658" released by "delete_volume" :: held 0.689s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Created reservations ['5f5a06d7-1c1e-4fa2-824e-86a8b25c2029', '6cdfa046-905f-4294-aaf7-cfa0e440f24e', '2ab9518e-04b4-4a83-a1f5-969e8053c541', 'c48dfc34-b345-4628-8de6-23332afa8367'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:18 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:18 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Creating offline snapshot 89c59373-5fa2-44a2-967a-c94a3ca060ad of volume 001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d846133-2ff1-4f43-b139-277bba3d27fe]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:18 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba.cc3261e0-dad5-4b64-a9b3-6ab1cef53264" returned: 0 in 0.297s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-cc3261e0-dad5-4b64-a9b3-6ab1cef53264" released by "_delete_snapshot" :: held 1.575s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" released by "delete_snapshot" :: held 1.599s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:18 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 Jul 21 08:28:18 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Created reservations ['f785997c-529e-49a9-94d2-fc696c09d35c', '29fa9e71-7b7d-4814-ab5a-c73eaedd8b95', '89663983-5523-431b-b66c-ec234a41ea58', '9aa8f5c1-4093-43dc-b961-d6eae5f839ba'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:18 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.296s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Deleted volume successfully. Jul 21 08:28:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-61fba653-555a-411d-89f4-47610e4fbd5f tempest-ProjectMemberTests-159017781 None] Lock "cinder-cc3261e0-dad5-4b64-a9b3-6ab1cef53264-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-aa87d6cd-ce23-4241-a795-c877709af86a tempest-ProjectReaderTests-831859969 None] Lock "cinder-28915260-9cfa-4d19-9982-10752a57b658-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:18 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413" returned: 0 in 0.448s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:18 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad 1G Jul 21 08:28:19 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-5eb8bb12-2495-4864-b367-f83475a756ba-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "cinder-5eb8bb12-2495-4864-b367-f83475a756ba-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (e638f176-145e-4d50-8240-fded53b79896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6eee91-9b42-46ca-8c0d-ccc2bc79759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6eee91-9b42-46ca-8c0d-ccc2bc79759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418476361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b842d4fd-76dd-4725-8958-34a25de9ccd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:19Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1d4285-744c-4e05-9b30-6e13a9fe8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1d4285-744c-4e05-9b30-6e13a9fe8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062a20bc-4ea7-4364-a5ed-280285a1810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062a20bc-4ea7-4364-a5ed-280285a1810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b842d4fd-76dd-4725-8958-34a25de9ccd2', 'volume_name': 'volume-b842d4fd-76dd-4725-8958-34a25de9ccd2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84ede8c-2472-4305-822d-8e122404e685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d84ede8c-2472-4305-822d-8e122404e685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1439f6d-ea3f-49dd-9db8-bc45e59d2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:19 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Volume b842d4fd-76dd-4725-8958-34a25de9ccd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b842d4fd-76dd-4725-8958-34a25de9ccd2', 'volume_size': 1} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" acquired by "delete_volume" :: waited 0.012s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[68026bc5-52e5-4c07-a2e3-63350bac92e4]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:19 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad 1G" returned: 0 in 0.489s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:19 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad Jul 21 08:28:19 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:19 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba Jul 21 08:28:19 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:19 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:19 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad is being set with open permissions: ugo+rw Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:19 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba" returned: 0 in 0.369s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:19 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad Jul 21 08:28:19 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:19 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba Jul 21 08:28:19 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:20 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad" returned: 0 in 0.245s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:20 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-5eb8bb12-2495-4864-b367-f83475a756ba" returned: 0 in 0.239s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-5eb8bb12-2495-4864-b367-f83475a756ba" released by "delete_volume" :: held 0.677s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:20 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info Jul 21 08:28:20 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Created reservations ['08f392ae-9b55-4f4d-86c6-79433ab22801', '82b5b6ac-a557-45b5-bcc7-0bf0375e5a9e', '93185730-8633-4f24-920b-ff1d9ecdd272', 'a3e4de97-ccab-4fcb-ba03-c57c2d9cf56a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:20 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:20 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:20 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:20 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info is being set with open permissions: ugo+rw Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:20 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info Jul 21 08:28:20 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:20 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.257s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-bcf1acbd-7863-4313-adc0-882dd65a7abb tempest-ProjectMemberTests-159017781 None] Lock "cinder-5eb8bb12-2495-4864-b367-f83475a756ba-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:20 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.info" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418476361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b842d4fd-76dd-4725-8958-34a25de9ccd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:19Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Creating volume b842d4fd-76dd-4725-8958-34a25de9ccd2 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:20 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:20 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 1073741824 Jul 21 08:28:20 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-6e526996-9092-4221-b250-09a52f161c2c tempest-ProjectReaderTests-488337387 None] Create snapshot completed successfully Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (1371477c-85d9-4a18-88f1-6559043858ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03862baf-989f-4985-a31b-ccd101049cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03862baf-989f-4985-a31b-ccd101049cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049024674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418a8162-8cd4-48e5-aa5d-2fea2993fe45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:21Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c812b-47bf-46b3-b2b9-cd6a2ec379f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468c812b-47bf-46b3-b2b9-cd6a2ec379f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5d51c5-609d-4d4d-bb16-c055a10f10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5d51c5-609d-4d4d-bb16-c055a10f10ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418a8162-8cd4-48e5-aa5d-2fea2993fe45', 'volume_name': 'volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a479e2-1b46-44f9-869d-8b1fe0207959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a479e2-1b46-44f9-869d-8b1fe0207959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e52dd2-2324-4593-b810-d872ee22129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Volume 418a8162-8cd4-48e5-aa5d-2fea2993fe45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45', 'volume_size': 1} Jul 21 08:28:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:21 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 1073741824" returned: 0 in 0.440s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:21 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 Jul 21 08:28:21 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:21 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049024674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418a8162-8cd4-48e5-aa5d-2fea2993fe45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:21Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Creating volume 418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:21 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1439f6d-ea3f-49dd-9db8-bc45e59d2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b842d4fd-76dd-4725-8958-34a25de9ccd2', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:21 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 1073741824 Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58026a70-064d-4ef5-9a52-006b94861c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:21 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Volume volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 (b842d4fd-76dd-4725-8958-34a25de9ccd2): created successfully Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58026a70-064d-4ef5-9a52-006b94861c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (e638f176-145e-4d50-8240-fded53b79896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2b119ad7-6762-4d84-aac4-2c35f2c573f0 tempest-ProjectReaderTests-831859969 None] Created volume successfully. Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-89c59373-5fa2-44a2-967a-c94a3ca060ad-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-89c59373-5fa2-44a2-967a-c94a3ca060ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-89c59373-5fa2-44a2-967a-c94a3ca060ad" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-89c59373-5fa2-44a2-967a-c94a3ca060ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Deleting offline snapshot 89c59373-5fa2-44a2-967a-c94a3ca060ad of volume 001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] snapshot_file for this snap is: volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c44203-55a5-4d74-8f23-ec37ad9d545d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:21 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad Jul 21 08:28:21 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:21 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 1073741824" returned: 0 in 0.507s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:21 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 Jul 21 08:28:21 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:22 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-001f457a-8c78-4bd7-bfbb-adb4028ca413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fb1baa-96d4-4e09-b1e3-186ecb6f2fb1]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:22 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e52dd2-2324-4593-b810-d872ee22129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa68c4b3-d3e7-4783-a8f3-5805af5eac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:22 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Volume volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 (418a8162-8cd4-48e5-aa5d-2fea2993fe45): created successfully Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa68c4b3-d3e7-4783-a8f3-5805af5eac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (1371477c-85d9-4a18-88f1-6559043858ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:22 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-bedeee3e-fd47-4c63-b8a4-b4c470e841c7 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:22 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 Jul 21 08:28:22 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-b842d4fd-76dd-4725-8958-34a25de9ccd2-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "cinder-b842d4fd-76dd-4725-8958-34a25de9ccd2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-quobyte-b842d4fd-76dd-4725-8958-34a25de9ccd2" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-b842d4fd-76dd-4725-8958-34a25de9ccd2" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf75199-6d78-43c4-9cf9-4caffde22964]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:22 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:22 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad Jul 21 08:28:22 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:22 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 Jul 21 08:28:22 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:22 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2" returned: 0 in 0.399s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:22 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad" returned: 0 in 0.373s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:22 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2 Jul 21 08:28:22 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:22 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:22 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad Jul 21 08:28:22 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 928713ca-9954-4870-b0c5-f75eebc3011d of volume 418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b21952-364a-4db4-870d-bc8a08282740]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:23 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b842d4fd-76dd-4725-8958-34a25de9ccd2" returned: 0 in 0.279s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:23 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413.89c59373-5fa2-44a2-967a-c94a3ca060ad" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-b842d4fd-76dd-4725-8958-34a25de9ccd2" released by "delete_volume" :: held 0.747s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-89c59373-5fa2-44a2-967a-c94a3ca060ad" released by "_delete_snapshot" :: held 1.517s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" released by "delete_snapshot" :: held 1.542s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:23 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 Jul 21 08:28:23 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Created reservations ['bbde61fe-045f-4e68-ae72-d2811116a363', 'eef85438-313d-412e-be99-145070bb6746', '870fc07e-0ede-4b51-a269-f8e3f8979adf', '15dbc6c0-2202-498f-bc81-11dde4c0284c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Created reservations ['f6c3e719-308a-4225-9cf5-41885376c283', '8ff65d1d-62c6-4f6e-9789-37f5471a3b61', '802a322e-8d97-4a3f-964d-41f8721dc5c2', '8896193f-6bfd-4070-ba51-e14ebdd56ef5'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Delete snapshot completed successfully. Jul 21 08:28:23 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:23 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-0db4c5f9-3bee-4371-a5ad-f51483fb1e9b tempest-ProjectReaderTests-488337387 None] Lock "cinder-89c59373-5fa2-44a2-967a-c94a3ca060ad-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45" returned: 0 in 0.414s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:23 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d 1G Jul 21 08:28:23 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:23 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.281s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:23 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Deleted volume successfully. Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b55b6983-eeae-45d5-ac05-4e6cda5d733c tempest-ProjectReaderTests-831859969 None] Lock "cinder-b842d4fd-76dd-4725-8958-34a25de9ccd2-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-001f457a-8c78-4bd7-bfbb-adb4028ca413-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "cinder-001f457a-8c78-4bd7-bfbb-adb4028ca413-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4645bdc2-65b3-4bc3-a815-74ec5f2932a6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d 1G" returned: 0 in 0.494s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 Jul 21 08:28:24 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d Jul 21 08:28:24 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (2602f6eb-1f0f-4ae6-afc3-4f1ccd3052bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbec5904-200b-48b0-b275-417ae88fc5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbec5904-200b-48b0-b275-417ae88fc5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233663071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:24Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b736edf-e1ba-46cf-bf46-be3f549811fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b736edf-e1ba-46cf-bf46-be3f549811fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f477a055-cdb3-4a1b-a191-bd0965b899e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f477a055-cdb3-4a1b-a191-bd0965b899e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a', 'volume_name': 'volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09596ce-8a71-4a72-a984-7da4b32203d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09596ce-8a71-4a72-a984-7da4b32203d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ef44e0-ec16-4346-af1d-1a43140288ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:24 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Volume ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a', 'volume_size': 1} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:24 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413" returned: 0 in 0.412s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413 Jul 21 08:28:24 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d" returned: 0 in 0.343s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d is being set with open permissions: ugo+rw Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d Jul 21 08:28:24 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-001f457a-8c78-4bd7-bfbb-adb4028ca413" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-001f457a-8c78-4bd7-bfbb-adb4028ca413" released by "delete_volume" :: held 0.724s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:24 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d" returned: 0 in 0.260s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Created reservations ['ca5f88a9-eb56-471a-9d44-88b3a254057c', 'f439b67a-65b1-4a8f-9b62-50dd85a9484f', 'a0602168-40b5-4c5e-bba6-1dd5638efc12', '8b4e8926-3a24-44a6-9332-8b3736d3b4e1'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:24 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info Jul 21 08:28:24 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:24 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:24 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info" returned: 0 in 0.275s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info is being set with open permissions: ugo+rw Jul 21 08:28:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:24 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info Jul 21 08:28:24 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:25 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.285s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Deleted volume successfully. Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-b0b41d5a-dc0c-43df-8a5d-796a14221e74 tempest-ProjectReaderTests-488337387 None] Lock "cinder-001f457a-8c78-4bd7-bfbb-adb4028ca413-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:25 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.info" returned: 0 in 0.278s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233663071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f43bcd888445a98c912723b1311c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:24Z,use_quota=True,user_id='2dd7d2be12d04df788b532920d4d11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Creating volume ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:25 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:25 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a 1073741824 Jul 21 08:28:25 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e5b6bf63-cda1-4d80-93a6-b8cdf6bce946 tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (486539cf-0007-4db7-9972-51cfdb904356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da8999-86e3-43a3-a660-531863fe7d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da8999-86e3-43a3-a660-531863fe7d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746904884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40829099-7cfa-47ab-a378-fbeb5dd77aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:25Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fe856e-ab77-4363-aecc-446400d3702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84fe856e-ab77-4363-aecc-446400d3702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e156f1-e44d-43eb-9a1b-5f865066ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e156f1-e44d-43eb-9a1b-5f865066ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40829099-7cfa-47ab-a378-fbeb5dd77aec', 'volume_name': 'volume-40829099-7cfa-47ab-a378-fbeb5dd77aec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18a6029-a0ab-4e9d-b27e-1073d6676791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18a6029-a0ab-4e9d-b27e-1073d6676791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ca651c-f40c-453b-9c2d-680ed701257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:25 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Volume 40829099-7cfa-47ab-a378-fbeb5dd77aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40829099-7cfa-47ab-a378-fbeb5dd77aec', 'volume_size': 1} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:25 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a 1073741824" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:25 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a Jul 21 08:28:25 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:25 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" returned: 0 in 0.248s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1746904884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40829099-7cfa-47ab-a378-fbeb5dd77aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:25Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Creating volume 40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:26 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ef44e0-ec16-4346-af1d-1a43140288ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:26 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec 1073741824 Jul 21 08:28:26 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e80da4-ef7a-4f88-81af-1bb0700314fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Volume volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a (ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a): created successfully Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e80da4-ef7a-4f88-81af-1bb0700314fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Flow 'volume_create_manager' (2602f6eb-1f0f-4ae6-afc3-4f1ccd3052bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d58deef1-9747-45d8-9cf5-fe388cd00dde tempest-ProjectReaderTests-831859969 None] Created volume successfully. Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-928713ca-9954-4870-b0c5-f75eebc3011d-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-928713ca-9954-4870-b0c5-f75eebc3011d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-928713ca-9954-4870-b0c5-f75eebc3011d" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-928713ca-9954-4870-b0c5-f75eebc3011d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 928713ca-9954-4870-b0c5-f75eebc3011d of volume 418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5c18ad-0202-4962-914f-142caa856f0c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:26 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d Jul 21 08:28:26 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:26 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec 1073741824" returned: 0 in 0.448s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:26 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec Jul 21 08:28:26 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:26 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d" returned: 0 in 0.371s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e213642-72aa-42fc-b667-e7d79f533ef7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:26 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ca651c-f40c-453b-9c2d-680ed701257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40829099-7cfa-47ab-a378-fbeb5dd77aec', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aa5efd-5c11-40a3-998c-eed1670fdfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:26 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Volume volume-40829099-7cfa-47ab-a378-fbeb5dd77aec (40829099-7cfa-47ab-a378-fbeb5dd77aec): created successfully Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aa5efd-5c11-40a3-998c-eed1670fdfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:26 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (486539cf-0007-4db7-9972-51cfdb904356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:26 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-22e28b76-fa77-43d2-9fb6-055b7c5f7dc5 tempest-ProjectReaderTests-488337387 None] Created volume successfully. Jul 21 08:28:26 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 Jul 21 08:28:26 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45" returned: 0 in 0.350s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:27 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d Jul 21 08:28:27 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "cinder-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Acquiring lock "cinder-quobyte-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be6605-517a-4815-a9a1-14a7112e5ce6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:27 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d" returned: 0 in 0.353s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:27 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a Jul 21 08:28:27 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d Jul 21 08:28:27 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45.928713ca-9954-4870-b0c5-f75eebc3011d" returned: 0 in 0.297s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:27 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" returned: 0 in 0.417s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-928713ca-9954-4870-b0c5-f75eebc3011d" released by "_delete_snapshot" :: held 1.485s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Creating offline snapshot 954abce8-9751-4530-a0ec-91117fad29f0 of volume 40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:27 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a Jul 21 08:28:27 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" released by "delete_snapshot" :: held 1.521s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e471a375-8271-46a0-9016-8422fb4703c7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Created reservations ['69bede2e-0a0d-4f52-b4bb-389434614c13', '4d57344b-62a3-4605-a10d-6f245b7e802c', '4393d314-639d-4bb8-957c-62711025be7f', 'eadc0596-921e-47d3-b2d9-6049a396aae5'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:27 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec Jul 21 08:28:27 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4d2aff2a-344c-491a-b9f3-4b05c35be828 tempest-ProjectMemberTests-159017781 None] Lock "cinder-928713ca-9954-4870-b0c5-f75eebc3011d-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:28 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "cinder-quobyte-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a" released by "delete_volume" :: held 0.724s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Created reservations ['4ebb6df9-48fd-43cc-9e2a-dc01cb4ad6a9', '865bc2bc-5d01-4cf3-b4c4-261ba2a690be', '2100f2a2-374a-481b-8063-c51145731873', '576bfbbd-148b-4c60-9a24-bda47cafa399'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:28 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:28 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:28 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec" returned: 0 in 0.385s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:28 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 1G Jul 21 08:28:28 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-418a8162-8cd4-48e5-aa5d-2fea2993fe45-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "cinder-418a8162-8cd4-48e5-aa5d-2fea2993fe45-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:28 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.321s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:28 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Deleted volume successfully. Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-97139837-4743-4088-85b3-bd9f23cd882a tempest-ProjectReaderTests-831859969 None] Lock "cinder-ed3edc2d-a59e-46a9-ba2a-e84ac646dd2a-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7fe7a7-86ac-4c48-baba-1cde1a2d1bb0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:28 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 1G" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40829099-7cfa-47ab-a378-fbeb5dd77aec -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:28 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 Jul 21 08:28:28 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:28 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40829099-7cfa-47ab-a378-fbeb5dd77aec -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 Jul 21 08:28:28 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:28 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45" returned: 0 in 0.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:29 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40829099-7cfa-47ab-a378-fbeb5dd77aec -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:29 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 is being set with open permissions: ugo+rw Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:29 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45 Jul 21 08:28:29 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:29 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 Jul 21 08:28:29 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:29 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-418a8162-8cd4-48e5-aa5d-2fea2993fe45" returned: 0 in 0.269s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:29 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0" returned: 0 in 0.265s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-418a8162-8cd4-48e5-aa5d-2fea2993fe45" released by "delete_volume" :: held 0.759s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:29 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info Jul 21 08:28:29 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Created reservations ['37762705-a539-4df2-8b5a-bfb1e8ec3633', '8ef591a3-f1e3-41ce-94a7-eaaecf53dda2', '361d7e67-2759-43e5-816b-46ca197042da', '2bbcae7f-a5ec-4139-bc6a-6c0816442c15'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:29 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:29 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:29 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info" returned: 0 in 0.373s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:29 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info is being set with open permissions: ugo+rw Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:29 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info Jul 21 08:28:29 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:29 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:29 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a1cbb580-e106-4119-9286-8b02c8e9399c tempest-ProjectMemberTests-159017781 None] Lock "cinder-418a8162-8cd4-48e5-aa5d-2fea2993fe45-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:30 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.info" returned: 0 in 0.381s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:30 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c9400caf-6ef4-4b44-9842-15b83fe0af90 tempest-ProjectReaderTests-488337387 None] Create snapshot completed successfully Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (bd484da4-d92c-498f-927e-f1f4452c0fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80930bbb-7d07-42d8-90e8-0cb259268f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80930bbb-7d07-42d8-90e8-0cb259268f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852231788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe7ec87-b58a-4af0-99ba-8ccdb493536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:30Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0665c044-4c88-47e4-bc07-c7a36ace81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0665c044-4c88-47e4-bc07-c7a36ace81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af86adf7-950e-4401-b0ec-9c057526659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af86adf7-950e-4401-b0ec-9c057526659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe7ec87-b58a-4af0-99ba-8ccdb493536e', 'volume_name': 'volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011d34aa-a2b4-4ef3-93a0-5eff671183bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011d34aa-a2b4-4ef3-93a0-5eff671183bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1cfcfa-d178-4770-b132-eea2bdfcdbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:30 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Volume fbe7ec87-b58a-4af0-99ba-8ccdb493536e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e', 'volume_size': 1} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-852231788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe7ec87-b58a-4af0-99ba-8ccdb493536e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:30Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Creating volume fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:30 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:30 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e 1073741824 Jul 21 08:28:30 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:30 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e 1073741824" returned: 0 in 0.434s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:30 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e Jul 21 08:28:30 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-954abce8-9751-4530-a0ec-91117fad29f0-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-954abce8-9751-4530-a0ec-91117fad29f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:30 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-954abce8-9751-4530-a0ec-91117fad29f0" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-954abce8-9751-4530-a0ec-91117fad29f0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Deleting offline snapshot 954abce8-9751-4530-a0ec-91117fad29f0 of volume 40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:31 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] snapshot_file for this snap is: volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" returned: 0 in 0.330s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1cfcfa-d178-4770-b132-eea2bdfcdbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a508d-c594-48a8-ba5f-38f088d5302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9fc30-df17-4b99-aaef-fb44d59d95ab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:31 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Volume volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e (fbe7ec87-b58a-4af0-99ba-8ccdb493536e): created successfully Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a508d-c594-48a8-ba5f-38f088d5302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (bd484da4-d92c-498f-927e-f1f4452c0fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:31 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b25acfdd-d7cf-43ae-8110-a3483eb47481 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:31 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 Jul 21 08:28:31 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:31 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0" returned: 0 in 0.368s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40829099-7cfa-47ab-a378-fbeb5dd77aec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7b24f2-3962-41e3-8163-6e6e9ea520a5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:31 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec Jul 21 08:28:31 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:31 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec" returned: 0 in 0.407s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:31 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:31 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 Jul 21 08:28:31 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:32 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:32 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0 Jul 21 08:28:32 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Creating offline snapshot a7e71613-fa81-4de7-95bd-c7e5cb060aec of volume fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd098b-482e-4bc2-aaa4-6fd10f98972a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:32 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec.954abce8-9751-4530-a0ec-91117fad29f0" returned: 0 in 0.325s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:32 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e Jul 21 08:28:32 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-954abce8-9751-4530-a0ec-91117fad29f0" released by "_delete_snapshot" :: held 1.633s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" released by "delete_snapshot" :: held 1.665s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Created reservations ['cc6b8303-bd35-48e7-9e21-043efe92efc7', 'ec555f24-562d-4a69-b7e9-13c6a633ced3', 'd8e7e3b8-be2b-4483-9311-0e9b51928168', '6049df41-f8a3-4164-8e7f-68e3ba83ae49'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:32 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Delete snapshot completed successfully. Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-3efba11e-3c3f-4421-98b5-bba4cc516642 tempest-ProjectReaderTests-488337387 None] Lock "cinder-954abce8-9751-4530-a0ec-91117fad29f0-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:32 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" returned: 0 in 0.420s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:32 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:32 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec 1G Jul 21 08:28:32 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-40829099-7cfa-47ab-a378-fbeb5dd77aec-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "cinder-40829099-7cfa-47ab-a378-fbeb5dd77aec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" acquired by "delete_volume" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d911e-4242-408d-b2c2-67c2a9dab149]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:33 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec 1G" returned: 0 in 0.472s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:33 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec Jul 21 08:28:33 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:33 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec Jul 21 08:28:33 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:33 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec" returned: 0 in 0.429s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:33 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:33 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec" returned: 0 in 0.347s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:33 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec is being set with open permissions: ugo+rw Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:33 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:33 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec Jul 21 08:28:33 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:33 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-40829099-7cfa-47ab-a378-fbeb5dd77aec" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:33 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-40829099-7cfa-47ab-a378-fbeb5dd77aec" released by "delete_volume" :: held 0.758s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:34 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec" returned: 0 in 0.302s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Created reservations ['cb94b2bc-e36e-439c-9663-9da22cde7b40', '017b463d-fde8-4065-8248-36b8c20f6c34', 'f09e4dfb-fafb-4164-ae28-e9261a5c5f74', 'ee4bc5a0-388d-4de2-a29a-dc6128e72e7a'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:34 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info Jul 21 08:28:34 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:34 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:34 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:34 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info" returned: 0 in 0.290s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:34 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info is being set with open permissions: ugo+rw Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:34 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info Jul 21 08:28:34 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:34 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Deleted volume successfully. Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ec83945-ad5a-4f29-9d41-fdc644198d00 tempest-ProjectReaderTests-488337387 None] Lock "cinder-40829099-7cfa-47ab-a378-fbeb5dd77aec-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:34 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.info" returned: 0 in 0.334s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:34 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5034703a-3c27-402c-aca3-a29bc74d55ec tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (1062a288-ac2a-4566-b471-73e1f1452843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2076a2-dc4d-4c64-ae80-f87d8d9bcf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2076a2-dc4d-4c64-ae80-f87d8d9bcf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142823644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dc6262-cb07-41f8-9988-f2b217c5cb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:35Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b896705-6976-423d-9813-043063e77fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b896705-6976-423d-9813-043063e77fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04e695d-0b44-4c77-8b50-5c078d02a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04e695d-0b44-4c77-8b50-5c078d02a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dc6262-cb07-41f8-9988-f2b217c5cb5a', 'volume_name': 'volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fb156d-cfe9-42af-8915-9596a19a0a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fb156d-cfe9-42af-8915-9596a19a0a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a105c-3524-449f-a28e-dd8b35c3d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:34 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Volume e2dc6262-cb07-41f8-9988-f2b217c5cb5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a', 'volume_size': 1} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142823644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dc6262-cb07-41f8-9988-f2b217c5cb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:35Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Creating volume e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:34 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:34 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:34 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a 1073741824 Jul 21 08:28:34 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:35 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a 1073741824" returned: 0 in 0.456s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:35 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a Jul 21 08:28:35 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-a7e71613-fa81-4de7-95bd-c7e5cb060aec-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-a7e71613-fa81-4de7-95bd-c7e5cb060aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-a7e71613-fa81-4de7-95bd-c7e5cb060aec" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-a7e71613-fa81-4de7-95bd-c7e5cb060aec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot a7e71613-fa81-4de7-95bd-c7e5cb060aec of volume fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:35 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" returned: 0 in 0.315s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf26388-5816-428f-a1f8-48a6982723ac]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401a105c-3524-449f-a28e-dd8b35c3d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9badba05-e9af-4b83-9fa7-53b83a7575d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:35 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Volume volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a (e2dc6262-cb07-41f8-9988-f2b217c5cb5a): created successfully Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9badba05-e9af-4b83-9fa7-53b83a7575d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:35 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (1062a288-ac2a-4566-b471-73e1f1452843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:35 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dcec36cd-bfff-4906-8a1a-67cc90e9aa5f tempest-ProjectReaderTests-488337387 None] Created volume successfully. Jul 21 08:28:35 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec Jul 21 08:28:35 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:36 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec" returned: 0 in 0.383s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa9737-ecb5-404d-b3b2-d9d945f3720b]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:36 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e Jul 21 08:28:36 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:36 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" returned: 0 in 0.392s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:36 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:36 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec Jul 21 08:28:36 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:37 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec" returned: 0 in 0.505s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:37 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec Jul 21 08:28:37 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Creating offline snapshot 11ec062b-4546-4226-b60b-9d52432f42e2 of volume e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5339e0-73da-41ff-ac8b-b9a0eb905aab]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:37 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a Jul 21 08:28:37 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:37 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e.a7e71613-fa81-4de7-95bd-c7e5cb060aec" returned: 0 in 0.291s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-a7e71613-fa81-4de7-95bd-c7e5cb060aec" released by "_delete_snapshot" :: held 1.687s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" released by "delete_snapshot" :: held 1.713s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Created reservations ['2bf01602-d523-4621-b17c-17965a92c2c3', '2e50b37b-d5d0-490b-bb94-8fe1dd499aa9', '7d3964ce-4a1c-4eec-9c7f-08dfa283d3e3', '3f29c7a2-b857-41f3-8d5c-fb5c218b206d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:37 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-52485640-1f11-4b04-a403-e4a5407a99a2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-a7e71613-fa81-4de7-95bd-c7e5cb060aec-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:37 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:37 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 1G Jul 21 08:28:37 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-fbe7ec87-b58a-4af0-99ba-8ccdb493536e-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-fbe7ec87-b58a-4af0-99ba-8ccdb493536e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:37 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54115c-46fd-4d49-be95-172e3ef309a5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e Jul 21 08:28:38 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:38 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 1G" returned: 0 in 0.580s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 Jul 21 08:28:38 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:38 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" returned: 0 in 0.411s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e Jul 21 08:28:38 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:38 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2" returned: 0 in 0.330s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:38 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 is being set with open permissions: ugo+rw Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 Jul 21 08:28:38 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:38 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" returned: 0 in 0.274s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-fbe7ec87-b58a-4af0-99ba-8ccdb493536e" released by "delete_volume" :: held 0.756s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:38 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2" returned: 0 in 0.266s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Created reservations ['1c001d25-3d3a-4796-a5c8-14c380c86139', '1bc1eb84-0efd-4946-8737-b9a8ea2710ab', 'a9d2bcf2-5868-4ea1-940e-cbdb208c5e65', 'f815a17a-a049-448f-b4f3-74985d609b02'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info Jul 21 08:28:38 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:38 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:38 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:38 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:39 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info" returned: 0 in 0.363s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:39 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info is being set with open permissions: ugo+rw Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:39 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:39 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info Jul 21 08:28:39 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-1ea4baac-858c-4db1-ab49-f157b4a342f8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-fbe7ec87-b58a-4af0-99ba-8ccdb493536e-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:39 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.info" returned: 0 in 0.316s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:39 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dea61bb1-d915-4965-802c-f6d3a0aaea7b tempest-ProjectReaderTests-488337387 None] Create snapshot completed successfully Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (45ab6fec-3d99-47af-82e1-8324f711efca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74c3639-68d2-4b39-832a-ef0a89141856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74c3639-68d2-4b39-832a-ef0a89141856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516057441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb98b78-f6f6-4380-ab40-850e5def78a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:40Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d96dafa-a7ab-4c87-a999-2032948f79b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d96dafa-a7ab-4c87-a999-2032948f79b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc79b6dc-b5c8-4f5f-861e-0149cd441f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc79b6dc-b5c8-4f5f-861e-0149cd441f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb98b78-f6f6-4380-ab40-850e5def78a8', 'volume_name': 'volume-4bb98b78-f6f6-4380-ab40-850e5def78a8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c975aa-675c-42aa-b3b0-5fc1da63ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c975aa-675c-42aa-b3b0-5fc1da63ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58e077-91b3-4775-85e7-5d255c75b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:39 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Volume 4bb98b78-f6f6-4380-ab40-850e5def78a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb98b78-f6f6-4380-ab40-850e5def78a8', 'volume_size': 1} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-516057441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb98b78-f6f6-4380-ab40-850e5def78a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:40Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Creating volume 4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:39 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:39 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:39 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 1073741824 Jul 21 08:28:39 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:40 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 1073741824" returned: 0 in 0.491s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:40 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 Jul 21 08:28:40 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-11ec062b-4546-4226-b60b-9d52432f42e2-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-11ec062b-4546-4226-b60b-9d52432f42e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-11ec062b-4546-4226-b60b-9d52432f42e2" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-11ec062b-4546-4226-b60b-9d52432f42e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Deleting offline snapshot 11ec062b-4546-4226-b60b-9d52432f42e2 of volume e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] snapshot_file for this snap is: volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca47fe1d-f970-4f86-b794-36780d980bf6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:40 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 Jul 21 08:28:40 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:40 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8" returned: 0 in 0.318s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc58e077-91b3-4775-85e7-5d255c75b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb98b78-f6f6-4380-ab40-850e5def78a8', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2906fa-0dea-4ad8-b2c6-005c9b27a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:40 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Volume volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 (4bb98b78-f6f6-4380-ab40-850e5def78a8): created successfully Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2906fa-0dea-4ad8-b2c6-005c9b27a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (45ab6fec-3d99-47af-82e1-8324f711efca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:40 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-b7ed73da-0906-458a-863f-289798f51b1c tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:40 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2" returned: 0 in 0.394s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084b046-a59e-451f-beb0-e5db322fe233]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:40 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:41 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a Jul 21 08:28:41 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:41 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" returned: 0 in 0.409s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:41 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 Jul 21 08:28:41 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:41 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2" returned: 0 in 0.513s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:41 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:41 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2 Jul 21 08:28:41 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 940b8ddd-aef8-47be-a609-63909f178c8b of volume 4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ab1ff-94cf-4bc3-b020-e0ecb6e82e65]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:42 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a.11ec062b-4546-4226-b60b-9d52432f42e2" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-11ec062b-4546-4226-b60b-9d52432f42e2" released by "_delete_snapshot" :: held 1.771s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" released by "delete_snapshot" :: held 1.803s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:42 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 Jul 21 08:28:42 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Created reservations ['a11ce915-01cb-486e-80a4-39d88113f89d', '4a2799ed-cffc-45ba-9ef4-d2f09fd2cdb5', '7fbb41c0-11df-47a5-931a-48c6ad1d6c16', 'fb9fafae-278a-4252-84cc-370bb4310c7b'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:42 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Delete snapshot completed successfully. Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-a2785c9f-5e24-458a-8ee4-cd4897a972f9 tempest-ProjectReaderTests-488337387 None] Lock "cinder-11ec062b-4546-4226-b60b-9d52432f42e2-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:42 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8" returned: 0 in 0.410s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:42 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b 1G Jul 21 08:28:42 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-e2dc6262-cb07-41f8-9988-f2b217c5cb5a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "cinder-e2dc6262-cb07-41f8-9988-f2b217c5cb5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ca839-0e23-40e4-a3bc-1e866550a28a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:42 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:42 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a Jul 21 08:28:42 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:43 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b 1G" returned: 0 in 0.512s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:43 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b Jul 21 08:28:43 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:43 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:43 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a Jul 21 08:28:43 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:43 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b" returned: 0 in 0.335s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:43 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b is being set with open permissions: ugo+rw Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:43 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b Jul 21 08:28:43 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:43 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" returned: 0 in 0.284s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-e2dc6262-cb07-41f8-9988-f2b217c5cb5a" released by "delete_volume" :: held 0.792s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Created reservations ['55db6705-273d-4b37-a4a0-4102f36064ae', '2b8bd0e3-b11e-494c-a9cf-d6a71dc353c1', '384324c1-c8cf-4777-926e-cc2a0ac15b15', 'ba1f07bd-fdcd-4895-898f-cce1cb1aa65c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:43 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b" returned: 0 in 0.293s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:43 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:43 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:43 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:43 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info Jul 21 08:28:43 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:44 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.488s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Deleted volume successfully. Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4dcf2c1e-456c-475a-bde3-65e5c0489c82 tempest-ProjectReaderTests-488337387 None] Lock "cinder-e2dc6262-cb07-41f8-9988-f2b217c5cb5a-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:44 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info" returned: 0 in 0.520s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:44 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info is being set with open permissions: ugo+rw Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:44 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info Jul 21 08:28:44 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:44 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.info" returned: 0 in 0.356s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (52661368-cbde-4525-98d1-455e4a6f6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c1804-e40a-4499-b0a5-b4be88befaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c1804-e40a-4499-b0a5-b4be88befaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651037596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d35f1-b111-4704-b58d-e118e1445640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:45Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd953d76-056c-4cf1-85c7-c5cceec4b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd953d76-056c-4cf1-85c7-c5cceec4b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc67e8d-fcf6-441b-8209-493c5b62a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc67e8d-fcf6-441b-8209-493c5b62a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414d35f1-b111-4704-b58d-e118e1445640', 'volume_name': 'volume-414d35f1-b111-4704-b58d-e118e1445640', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cf0914-c186-4c0c-9fc4-f00bceebe7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cf0914-c186-4c0c-9fc4-f00bceebe7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d95e925-3a54-434b-ae55-ac529e392f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:44 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Volume 414d35f1-b111-4704-b58d-e118e1445640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414d35f1-b111-4704-b58d-e118e1445640', 'volume_size': 1} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1651037596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414d35f1-b111-4704-b58d-e118e1445640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21ea834c053e41498ba0504052a0f239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:45Z,use_quota=True,user_id='c6a9363e6647440c98be7e7e11c99796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Creating volume 414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:44 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:44 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:44 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-91df077e-d5ca-4e07-ab81-7e5e09520fba tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:44 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 1073741824 Jul 21 08:28:44 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:45 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 1073741824" returned: 0 in 0.483s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-940b8ddd-aef8-47be-a609-63909f178c8b-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:45 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 Jul 21 08:28:45 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-940b8ddd-aef8-47be-a609-63909f178c8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-940b8ddd-aef8-47be-a609-63909f178c8b" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-940b8ddd-aef8-47be-a609-63909f178c8b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 940b8ddd-aef8-47be-a609-63909f178c8b of volume 4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e783e15-bb0b-4c3a-bfec-406164e59f1d]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:45 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b Jul 21 08:28:45 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:45 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640" returned: 0 in 0.310s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d95e925-3a54-434b-ae55-ac529e392f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414d35f1-b111-4704-b58d-e118e1445640', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4901dc6e-9824-44c8-9d33-d3d947bed56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:45 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Volume volume-414d35f1-b111-4704-b58d-e118e1445640 (414d35f1-b111-4704-b58d-e118e1445640): created successfully Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4901dc6e-9824-44c8-9d33-d3d947bed56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Flow 'volume_create_manager' (52661368-cbde-4525-98d1-455e4a6f6df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:45 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-0c19e917-7ee6-43ed-adff-00c9a4ea8140 tempest-ProjectReaderTests-488337387 None] Created volume successfully. Jul 21 08:28:45 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b" returned: 0 in 0.402s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bb98b78-f6f6-4380-ab40-850e5def78a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7c896-5558-4d8b-b3d1-963bcb8bc62e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:45 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:45 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 Jul 21 08:28:45 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:46 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8" returned: 0 in 0.360s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:46 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b Jul 21 08:28:46 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:46 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b" returned: 0 in 0.356s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:46 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b Jul 21 08:28:46 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:46 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8.940b8ddd-aef8-47be-a609-63909f178c8b" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-940b8ddd-aef8-47be-a609-63909f178c8b" released by "_delete_snapshot" :: held 1.508s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" released by "delete_snapshot" :: held 1.536s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Creating offline snapshot 71be389c-1ede-4575-af89-7fefaa38d5af of volume 414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a99433-6bb7-4ac5-bd79-a3e4eb275299]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:46 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Created reservations ['8d9a9240-0b2b-439c-8a64-29a129e80461', '2f7fcc87-0fa7-435f-b322-da8fda28ffb8', '0af0354e-b88b-4f8a-ae2c-6664a847b6ac', '960bec91-2357-4f59-9478-7edf7f572d2d'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:47 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-7637b7fc-17a8-4ad4-b786-563f478271d8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-940b8ddd-aef8-47be-a609-63909f178c8b-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:47 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 Jul 21 08:28:47 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:47 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640" returned: 0 in 0.372s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:47 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af 1G Jul 21 08:28:47 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-4bb98b78-f6f6-4380-ab40-850e5def78a8-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-4bb98b78-f6f6-4380-ab40-850e5def78a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" acquired by "delete_volume" :: waited 0.030s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d73c48-5ec1-4ca1-bf1d-76a71deaa985]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:47 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 Jul 21 08:28:47 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:47 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af 1G" returned: 0 in 0.677s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:47 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d35f1-b111-4704-b58d-e118e1445640 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:47 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d35f1-b111-4704-b58d-e118e1445640 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af Jul 21 08:28:47 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8" returned: 0 in 0.441s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:48 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8 Jul 21 08:28:48 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-414d35f1-b111-4704-b58d-e118e1445640 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af" returned: 0 in 0.313s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af is being set with open permissions: ugo+rw Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:48 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af Jul 21 08:28:48 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4bb98b78-f6f6-4380-ab40-850e5def78a8" returned: 0 in 0.295s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-4bb98b78-f6f6-4380-ab40-850e5def78a8" released by "delete_volume" :: held 0.828s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Created reservations ['cb8b10c1-174b-4eef-ac2f-263d45a653b6', '2f216421-80c4-4f69-bc0f-51c3f18cbff3', '3357f2c0-8fbd-4347-b771-d72e86a329d7', '6b3a7782-882f-4472-a1d7-413a55605d74'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:48 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af" returned: 0 in 0.267s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:48 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info Jul 21 08:28:48 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:48 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:48 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info is being set with open permissions: ugo+rw Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:48 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info Jul 21 08:28:48 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:48 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.301s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:48 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:48 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-2433ae36-4779-45b6-9a93-16206103d5a8 tempest-ProjectMemberTests-159017781 None] Lock "cinder-4bb98b78-f6f6-4380-ab40-850e5def78a8-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:49 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.info" returned: 0 in 0.307s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:49 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e891b3a1-3a53-48c2-8ad1-941da69d5f5f tempest-ProjectReaderTests-488337387 None] Create snapshot completed successfully Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (079f4aca-d17f-4686-b257-b2059c32104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e28db1-107e-487d-b2f3-8d1ebb06ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e28db1-107e-487d-b2f3-8d1ebb06ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160204488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49eafea-a0c7-486a-9730-632565a40865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:49Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4e96f4-6f40-4a53-b6bc-2577d31683e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4e96f4-6f40-4a53-b6bc-2577d31683e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eca3e7b-d40f-4c70-acf6-1b123c60e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eca3e7b-d40f-4c70-acf6-1b123c60e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49eafea-a0c7-486a-9730-632565a40865', 'volume_name': 'volume-e49eafea-a0c7-486a-9730-632565a40865', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f595041f-74f5-4377-b455-fa8e7bd312d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f595041f-74f5-4377-b455-fa8e7bd312d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa35cdc-80e5-413a-90a7-a2dbe1ea6cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:49 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Volume e49eafea-a0c7-486a-9730-632565a40865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49eafea-a0c7-486a-9730-632565a40865', 'volume_size': 1} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160204488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49eafea-a0c7-486a-9730-632565a40865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:49Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Creating volume e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:49 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:49 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 1073741824 Jul 21 08:28:49 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:49 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 1073741824" returned: 0 in 0.494s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:49 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:49 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 Jul 21 08:28:49 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-71be389c-1ede-4575-af89-7fefaa38d5af-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-71be389c-1ede-4575-af89-7fefaa38d5af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-71be389c-1ede-4575-af89-7fefaa38d5af" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-71be389c-1ede-4575-af89-7fefaa38d5af" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Deleting offline snapshot 71be389c-1ede-4575-af89-7fefaa38d5af of volume 414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] snapshot_file for this snap is: volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7eb60c-5e73-4f03-a4e3-27f227940e72]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:50 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865" returned: 0 in 0.375s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa35cdc-80e5-413a-90a7-a2dbe1ea6cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49eafea-a0c7-486a-9730-632565a40865', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3a6b4c-a3b8-4979-b344-7fb80717bbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:50 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Volume volume-e49eafea-a0c7-486a-9730-632565a40865 (e49eafea-a0c7-486a-9730-632565a40865): created successfully Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3a6b4c-a3b8-4979-b344-7fb80717bbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (079f4aca-d17f-4686-b257-b2059c32104a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:50 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af Jul 21 08:28:50 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:50 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-a9b3a9b8-83f4-4d3c-9c1e-6e803cd6759a tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:28:50 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-414d35f1-b111-4704-b58d-e118e1445640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[f659e3ad-a6a3-4d5d-ba26-240e6fb28f5f]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:50 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:50 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 Jul 21 08:28:50 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:51 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:51 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af Jul 21 08:28:51 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:51 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:51 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af Jul 21 08:28:51 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 43f3dd34-652a-4f66-8edd-7982a56abc1d of volume e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4b6955-b822-4102-8e48-d7a42b4950bc]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:51 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 Jul 21 08:28:51 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:51 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640.71be389c-1ede-4575-af89-7fefaa38d5af" returned: 0 in 0.327s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-71be389c-1ede-4575-af89-7fefaa38d5af" released by "_delete_snapshot" :: held 1.714s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" released by "delete_snapshot" :: held 1.758s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:51 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Created reservations ['f332175f-32db-4643-926a-5e83689ad404', '86bc55ce-9d82-4330-a944-24ad31cdd5a0', '6f92de71-7385-4550-98c0-f5bb7a0da259', '9e827dac-495d-4659-9948-3da75d61ad91'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:52 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Delete snapshot completed successfully. Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-d92f7638-4946-466b-962f-c5087549e1d7 tempest-ProjectReaderTests-488337387 None] Lock "cinder-71be389c-1ede-4575-af89-7fefaa38d5af-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:52 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865" returned: 0 in 0.442s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d 1G Jul 21 08:28:52 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-414d35f1-b111-4704-b58d-e118e1445640-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "cinder-414d35f1-b111-4704-b58d-e118e1445640-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Acquiring lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473f62d-4d98-4e9f-8c9a-bd5b919ad78a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 Jul 21 08:28:52 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d 1G" returned: 0 in 0.501s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49eafea-a0c7-486a-9730-632565a40865 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49eafea-a0c7-486a-9730-632565a40865 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d Jul 21 08:28:52 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:52 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640" returned: 0 in 0.461s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49eafea-a0c7-486a-9730-632565a40865 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d" returned: 0 in 0.324s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:52 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d is being set with open permissions: ugo+rw Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:52 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640 Jul 21 08:28:52 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d Jul 21 08:28:52 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:52 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.327s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:52 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_service.periodic_task [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] Running periodic task VolumeManager._thread_info {{(pid=87372) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread count: 28 {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-ea40d28d-3db3-456b-8f3e-dba0af3010c2 None None] thread info: [<_MainThread(MainThread, started 127694219911296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87372) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 21 08:28:53 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-414d35f1-b111-4704-b58d-e118e1445640" returned: 0 in 0.308s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:53 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d" returned: 0 in 0.289s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "cinder-quobyte-414d35f1-b111-4704-b58d-e118e1445640" released by "delete_volume" :: held 0.840s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:53 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info Jul 21 08:28:53 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Created reservations ['23bec534-6267-4ad7-a943-a5084f2c5385', '6bbc580c-945e-4b98-bf8b-667f5527b3e0', 'e34c47bc-eeed-4762-a9f4-6e20559b515b', '233fc78f-b715-43ef-9860-54b613e370da'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:53 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:53 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:53 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info" returned: 0 in 0.426s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:53 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info is being set with open permissions: ugo+rw Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:53 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info Jul 21 08:28:53 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:53 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:53 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Deleted volume successfully. Jul 21 08:28:53 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5620df17-77d2-4975-bbcf-6f5a79de0f90 tempest-ProjectReaderTests-488337387 None] Lock "cinder-414d35f1-b111-4704-b58d-e118e1445640-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:54 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.info" returned: 0 in 0.349s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:54 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-96d5c2dc-a260-4936-8b88-e586b9b4ded7 tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-43f3dd34-652a-4f66-8edd-7982a56abc1d-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-43f3dd34-652a-4f66-8edd-7982a56abc1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-43f3dd34-652a-4f66-8edd-7982a56abc1d" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-43f3dd34-652a-4f66-8edd-7982a56abc1d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 43f3dd34-652a-4f66-8edd-7982a56abc1d of volume e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf7b2fc-7696-4539-ae38-7439c962172a]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:54 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:55 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d Jul 21 08:28:55 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Flow 'volume_create_manager' (765bd988-b808-49d6-80c7-b3d26839fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd605e02-5005-47f8-a8a7-bd387b8425f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd605e02-5005-47f8-a8a7-bd387b8425f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284096064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b310c47-9862-4e6d-b76e-f4bb3ded7961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a464d6c5790b47d9bcb2d01d2d979f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:55Z,use_quota=True,user_id='f026d4af4ae648e7bf288e6be72f6c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379f5803-e3e9-46f6-a009-13e396c8c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379f5803-e3e9-46f6-a009-13e396c8c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40741f-d8cf-4447-ad06-4d14bf11f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40741f-d8cf-4447-ad06-4d14bf11f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b310c47-9862-4e6d-b76e-f4bb3ded7961', 'volume_name': 'volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629fa7f7-1201-4a37-a9e5-086ad1dbd9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629fa7f7-1201-4a37-a9e5-086ad1dbd9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc26f87-2573-4010-bfa6-dfb436a1f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:55 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Volume 4b310c47-9862-4e6d-b76e-f4bb3ded7961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961', 'volume_size': 1} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1284096064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b310c47-9862-4e6d-b76e-f4bb3ded7961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a464d6c5790b47d9bcb2d01d2d979f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:55Z,use_quota=True,user_id='f026d4af4ae648e7bf288e6be72f6c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Creating volume 4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:55 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:55 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 1073741824 Jul 21 08:28:55 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:55 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e49eafea-a0c7-486a-9730-632565a40865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e4cb0-e805-4dbd-8fb1-a54ebee142e0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:55 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 Jul 21 08:28:55 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:55 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 1073741824" returned: 0 in 0.504s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:55 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865" returned: 0 in 0.437s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:55 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:55 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:28:55 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:55 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d Jul 21 08:28:55 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:56 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc26f87-2573-4010-bfa6-dfb436a1f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293c8ddb-83be-4284-a7b7-f7dcb8883eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:56 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Volume volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 (4b310c47-9862-4e6d-b76e-f4bb3ded7961): created successfully Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293c8ddb-83be-4284-a7b7-f7dcb8883eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Flow 'volume_create_manager' (765bd988-b808-49d6-80c7-b3d26839fc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-545e7d33-8ac5-469d-8763-53fdd8ee767f tempest-SnapshotDependencyTests-150477753 None] Created volume successfully. Jul 21 08:28:56 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d" returned: 0 in 0.387s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:56 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d Jul 21 08:28:56 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:56 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865.43f3dd34-652a-4f66-8edd-7982a56abc1d" returned: 0 in 0.254s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-43f3dd34-652a-4f66-8edd-7982a56abc1d" released by "_delete_snapshot" :: held 1.619s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" released by "delete_snapshot" :: held 1.649s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Created reservations ['aa45f981-d198-409d-8cae-3808a6049cb2', 'a52b7e80-cb4e-4338-aa44-c7a17a04d3d7', '8c12b86d-716e-4bf7-8a16-981a2e075b63', 'd4eaa9ed-349e-425e-9865-bb3309880e9f'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:56 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-108fe013-e120-4bd1-a3ed-9150a6bf0234 tempest-ProjectMemberTests-159017781 None] Lock "cinder-43f3dd34-652a-4f66-8edd-7982a56abc1d-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:56 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-e49eafea-a0c7-486a-9730-632565a40865-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "cinder-e49eafea-a0c7-486a-9730-632565a40865-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[32adbbff-2e1e-4b06-bc81-5ac12786fc07]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:57 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 Jul 21 08:28:57 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:57 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865" returned: 0 in 0.408s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Creating offline snapshot 8f35743b-eb2d-4349-a985-67beb6947aee of volume 4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:28:57 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865 Jul 21 08:28:57 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46a545-95ed-41e9-b679-0f412bc14ee6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:57 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:28:57 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:57 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-e49eafea-a0c7-486a-9730-632565a40865" returned: 0 in 0.281s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-e49eafea-a0c7-486a-9730-632565a40865" released by "delete_volume" :: held 0.778s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Created reservations ['9347c4b9-f7d4-46a3-aa62-b3de3913cae3', 'e5e1e842-bbfb-43a1-b2ef-1aee8a664b2e', 'fd4d218b-5958-416b-b42b-4b6a3a1cdd32', '65c84a29-b993-4621-b4ec-408874ccbdfd'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:57 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:58 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:28:58 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:58 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.427s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:58 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee 1G Jul 21 08:28:58 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:58 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:28:58 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4c3410bc-3136-47f5-bf12-fa8de6cd1a90 tempest-ProjectMemberTests-159017781 None] Lock "cinder-e49eafea-a0c7-486a-9730-632565a40865-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:28:58 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee 1G" returned: 0 in 0.442s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:58 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:28:58 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (0753ef1c-15c0-4784-b648-64936ffb165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0208b36-69c7-4230-82f1-066d06adb2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0208b36-69c7-4230-82f1-066d06adb2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066364440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b440a3b3-edc3-423f-b563-6debb2c64b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:59Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68466f4d-4636-4b8c-a590-82606d92a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68466f4d-4636-4b8c-a590-82606d92a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3127e73-b46b-4f73-ac82-d95a68de9181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3127e73-b46b-4f73-ac82-d95a68de9181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b440a3b3-edc3-423f-b563-6debb2c64b4a', 'volume_name': 'volume-b440a3b3-edc3-423f-b563-6debb2c64b4a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbaf01b-27a4-4287-b152-e9c897cb9869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbaf01b-27a4-4287-b152-e9c897cb9869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3f321-bd5f-4a8d-adb8-234d64178afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:28:58 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Volume b440a3b3-edc3-423f-b563-6debb2c64b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b440a3b3-edc3-423f-b563-6debb2c64b4a', 'volume_size': 1} Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:58 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.335s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:58 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee is being set with open permissions: ugo+rw Jul 21 08:28:58 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:58 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:28:58 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:59 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:59 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info Jul 21 08:28:59 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:59 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:59 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info is being set with open permissions: ugo+rw Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:59 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info Jul 21 08:28:59 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:59 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.info" returned: 0 in 0.253s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066364440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b440a3b3-edc3-423f-b563-6debb2c64b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:28:59Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Creating volume b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:28:59 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=204,cinder:INSERT=72,cinder:UPDATE=274,cinder:DELETE=28 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:28:59 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a 1073741824 Jul 21 08:28:59 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:28:59 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=209,cinder:INSERT=72,cinder:UPDATE=264,cinder:DELETE=16 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:28:59 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-65317993-2e9e-4abe-a64c-114d8e93fcab tempest-SnapshotDependencyTests-150477753 None] Create snapshot completed successfully Jul 21 08:29:00 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a 1073741824" returned: 0 in 0.435s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:00 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a Jul 21 08:29:00 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:00 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e3f321-bd5f-4a8d-adb8-234d64178afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b440a3b3-edc3-423f-b563-6debb2c64b4a', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6571c8-ab3b-45a9-9da0-f27cd7f09f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:00 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Volume volume-b440a3b3-edc3-423f-b563-6debb2c64b4a (b440a3b3-edc3-423f-b563-6debb2c64b4a): created successfully Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6571c8-ab3b-45a9-9da0-f27cd7f09f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (0753ef1c-15c0-4784-b648-64936ffb165c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:00 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-2fed2683-c504-481f-813a-7d7443430b80 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 8316db78-a5f6-4063-aec1-2dddf0dac5c6 of volume b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc752d5-426a-48cb-811c-a022debbe639]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:00 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:01 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a Jul 21 08:29:01 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Flow 'volume_create_manager' (ba788068-8d00-422a-8476-1d77609d7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e002799-9b13-4f83-8ec0-5c9b586e428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e002799-9b13-4f83-8ec0-5c9b586e428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d98ac56-3800-49a0-8eaa-069bc21c1589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a464d6c5790b47d9bcb2d01d2d979f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f35743b-eb2d-4349-a985-67beb6947aee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:01Z,use_quota=True,user_id='f026d4af4ae648e7bf288e6be72f6c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b537d60-6d57-4be7-9188-1cac99c9ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b537d60-6d57-4be7-9188-1cac99c9ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a41fe09-2b73-4f07-abe8-f0b034e054b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a41fe09-2b73-4f07-abe8-f0b034e054b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d98ac56-3800-49a0-8eaa-069bc21c1589', 'volume_name': 'volume-7d98ac56-3800-49a0-8eaa-069bc21c1589', 'volume_size': 1, 'snapshot_id': '8f35743b-eb2d-4349-a985-67beb6947aee'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4ca624-96ae-4460-a72c-7062c718d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4ca624-96ae-4460-a72c-7062c718d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c5114-c137-41e7-ac13-b25b990750c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:01 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Volume 7d98ac56-3800-49a0-8eaa-069bc21c1589: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d98ac56-3800-49a0-8eaa-069bc21c1589', 'volume_size': 1, 'snapshot_id': '8f35743b-eb2d-4349-a985-67beb6947aee'} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:01 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a" returned: 0 in 0.496s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:01 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 1G Jul 21 08:29:01 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:01 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 1G" returned: 0 in 0.532s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:01 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440a3b3-edc3-423f-b563-6debb2c64b4a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:01 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440a3b3-edc3-423f-b563-6debb2c64b4a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 Jul 21 08:29:02 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:02 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b440a3b3-edc3-423f-b563-6debb2c64b4a -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6" returned: 0 in 0.285s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:02 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 is being set with open permissions: ugo+rw Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:02 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 Jul 21 08:29:02 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:02 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6" returned: 0 in 0.233s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:02 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info Jul 21 08:29:02 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:02 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info" returned: 0 in 0.270s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:02 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info is being set with open permissions: ugo+rw Jul 21 08:29:02 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:02 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info Jul 21 08:29:02 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:03 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.info" returned: 0 in 0.258s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.645s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee-7d98ac56-3800-49a0-8eaa-069bc21c1589" by "_create_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee-7d98ac56-3800-49a0-8eaa-069bc21c1589" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Creating volume 7d98ac56-3800-49a0-8eaa-069bc21c1589 from snapshot 8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" by "_copy_volume_from_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:03 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-97dba361-198e-44a3-8e26-c6651b5d48d4 tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] snapshot: 8f35743b-eb2d-4349-a985-67beb6947aee, volume: 7d98ac56-3800-49a0-8eaa-069bc21c1589, {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a41b725-2815-4f78-b02f-63b08136cfae]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:03 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:29:03 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:03 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.390s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Creating direct copy from snapshot {{(pid=87372) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f5bdf-a3cc-4b1e-9f5f-4c2730f845c5]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:03 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:29:03 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:03 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.382s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG cinder.utils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Path /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 not found in is_blk_device check {{(pid=87372) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 21 08:29:03 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:04 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 Jul 21 08:29:04 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-8316db78-a5f6-4063-aec1-2dddf0dac5c6-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-8316db78-a5f6-4063-aec1-2dddf0dac5c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-8316db78-a5f6-4063-aec1-2dddf0dac5c6" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-8316db78-a5f6-4063-aec1-2dddf0dac5c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 8316db78-a5f6-4063-aec1-2dddf0dac5c6 of volume b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[75834c4c-d741-4b79-ae7f-3b94baa6da73]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:04 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 Jul 21 08:29:04 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:04 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6" returned: 0 in 0.676s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b440a3b3-edc3-423f-b563-6debb2c64b4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe21522-ca13-4d62-9699-d9b87c7ef808]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:04 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:05 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a Jul 21 08:29:05 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:05 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a" returned: 0 in 0.707s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:05 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:05 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 Jul 21 08:29:05 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:06 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6" returned: 0 in 0.843s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:06 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:06 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6 Jul 21 08:29:06 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:07 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:07 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a.8316db78-a5f6-4063-aec1-2dddf0dac5c6" returned: 0 in 0.681s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-8316db78-a5f6-4063-aec1-2dddf0dac5c6" released by "_delete_snapshot" :: held 3.106s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" released by "delete_snapshot" :: held 3.145s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:07 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Created reservations ['8442c25c-4549-4a17-95e7-4df014007123', '236eae57-1f31-469f-b10a-8eb5dd2a25ca', '414a1abf-b1e1-4c5d-ba1c-e45d2b613380', '134d7973-3af4-44ed-9dbd-7887258280cb'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:07 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:29:07 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c05c8135-ebce-4741-a866-ed342a62d7f2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-8316db78-a5f6-4063-aec1-2dddf0dac5c6-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-b440a3b3-edc3-423f-b563-6debb2c64b4a-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "cinder-b440a3b3-edc3-423f-b563-6debb2c64b4a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b57acc-6ddf-422c-b34c-9a99c8e39c39]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:08 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:08 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a Jul 21 08:29:08 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:09 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589" returned: 0 in 5.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4bf92-2b2c-49a0-bca7-7c986d476bb7]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:09 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a" returned: 0 in 0.539s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:09 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:29:09 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:09 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a Jul 21 08:29:09 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Flow 'volume_create_manager' (e25f0f67-92f4-4505-93d0-3ccfc5b4ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62610dcb-7c29-4896-a56a-81609fc446e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62610dcb-7c29-4896-a56a-81609fc446e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779817398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92c75e8-4141-4f2b-b3dd-de200d23be66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b8ea4c76d54e97baf894f276a1f00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:10Z,use_quota=True,user_id='762dbf628fc74d74b22afa5a33279a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c37541-f715-4286-bd00-6e2625a4379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c37541-f715-4286-bd00-6e2625a4379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb03d11c-0dba-44c8-8df6-3878b6b2dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb03d11c-0dba-44c8-8df6-3878b6b2dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92c75e8-4141-4f2b-b3dd-de200d23be66', 'volume_name': 'volume-c92c75e8-4141-4f2b-b3dd-de200d23be66', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2558c066-dd14-474d-9175-690090d12c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:09 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2558c066-dd14-474d-9175-690090d12c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5613c52-0705-44f0-af12-3516e1352234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:09 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Volume c92c75e8-4141-4f2b-b3dd-de200d23be66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92c75e8-4141-4f2b-b3dd-de200d23be66', 'volume_size': 1} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-b440a3b3-edc3-423f-b563-6debb2c64b4a" returned: 0 in 0.300s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-b440a3b3-edc3-423f-b563-6debb2c64b4a" released by "delete_volume" :: held 0.998s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Created reservations ['98ea460c-1ef7-4db6-93dd-44a0bb9ecd2e', 'b8dbfa23-c0ca-43b5-88b2-17022dec61a9', '57deffb4-528a-4c89-be4c-a74599ed41ae', 'dc44e1b6-4064-44ed-a9da-5bc26e4dc2a4'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:09 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.565s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG cinder.image.image_utils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 {{(pid=87372) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 21 08:29:09 devstack cinder-volume[87372]: INFO cinder.image.image_utils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Converted 1024.00 MB image at 194.13 MB/s Jul 21 08:29:09 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 is being set with open permissions: ugo+rw Jul 21 08:29:09 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:09 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:09 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:09 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 Jul 21 08:29:09 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:10 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:29:10 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589" returned: 0 in 0.245s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" released by "_copy_volume_from_snapshot" :: held 6.952s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-e63522e5-2c40-4435-aa3b-641e043d9a70 tempest-ProjectMemberTests-159017781 None] Lock "cinder-b440a3b3-edc3-423f-b563-6debb2c64b4a-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee-7d98ac56-3800-49a0-8eaa-069bc21c1589" released by "_create_volume_from_snapshot" :: held 6.988s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.014s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779817398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92c75e8-4141-4f2b-b3dd-de200d23be66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b8ea4c76d54e97baf894f276a1f00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:10Z,use_quota=True,user_id='762dbf628fc74d74b22afa5a33279a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Creating volume c92c75e8-4141-4f2b-b3dd-de200d23be66 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:10 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 1073741824 Jul 21 08:29:10 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5c5114-c137-41e7-ac13-b25b990750c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d98ac56-3800-49a0-8eaa-069bc21c1589', 'volume_size': 1, 'snapshot_id': '8f35743b-eb2d-4349-a985-67beb6947aee'}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab29d4-bd09-4be9-8afb-9a84b8e7c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Volume volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 (7d98ac56-3800-49a0-8eaa-069bc21c1589): created successfully Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab29d4-bd09-4be9-8afb-9a84b8e7c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Flow 'volume_create_manager' (ba788068-8d00-422a-8476-1d77609d7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5cdbc177-e1ae-4a22-8a71-81b808a69bdb tempest-SnapshotDependencyTests-150477753 None] Created volume successfully. Jul 21 08:29:10 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 1073741824" returned: 0 in 0.409s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:10 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 Jul 21 08:29:10 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:10 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66" returned: 0 in 0.246s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5613c52-0705-44f0-af12-3516e1352234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92c75e8-4141-4f2b-b3dd-de200d23be66', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e07957-9402-410a-8d77-d1d4bae79f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Volume volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 (c92c75e8-4141-4f2b-b3dd-de200d23be66): created successfully Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e07957-9402-410a-8d77-d1d4bae79f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:10 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Flow 'volume_create_manager' (e25f0f67-92f4-4505-93d0-3ccfc5b4ced0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:10 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-dfd9f432-525c-4a6b-9840-9f7387a69595 tempest-ProjectReaderTests-1562816959 None] Created volume successfully. Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-8f35743b-eb2d-4349-a985-67beb6947aee-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-8f35743b-eb2d-4349-a985-67beb6947aee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Deleting offline snapshot 8f35743b-eb2d-4349-a985-67beb6947aee of volume 4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] snapshot_file for this snap is: volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[24499f9e-e318-40ca-9a60-a4f4f193d404]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (4c79532e-ea51-4a2f-8ffa-64424848d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962b4eec-415f-42a1-9d0c-f1179d9dcef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:11 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:29:11 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962b4eec-415f-42a1-9d0c-f1179d9dcef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19520235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf39c7e6-8e1c-443b-9461-a82b60343108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:11Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0a3e4d-2f3f-40a0-92d9-4c97cc02a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0a3e4d-2f3f-40a0-92d9-4c97cc02a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99819239-ec20-46b0-bb4e-7f40164691bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99819239-ec20-46b0-bb4e-7f40164691bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf39c7e6-8e1c-443b-9461-a82b60343108', 'volume_name': 'volume-bf39c7e6-8e1c-443b-9461-a82b60343108', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd666ef-0b36-4526-a619-d47f08c72b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd666ef-0b36-4526-a619-d47f08c72b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d6f02f-7d52-406e-b71c-9bfecbaf820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:11 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Volume bf39c7e6-8e1c-443b-9461-a82b60343108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf39c7e6-8e1c-443b-9461-a82b60343108', 'volume_size': 1} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19520235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf39c7e6-8e1c-443b-9461-a82b60343108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:11Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Creating volume bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:29:11 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:11 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 1073741824 Jul 21 08:29:11 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:11 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab1ee7b-5cc8-4038-b8c1-38130d524452]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:11 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:29:11 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "cinder-c92c75e8-4141-4f2b-b3dd-de200d23be66-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "cinder-c92c75e8-4141-4f2b-b3dd-de200d23be66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "cinder-quobyte-c92c75e8-4141-4f2b-b3dd-de200d23be66" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:11 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 1073741824" returned: 0 in 0.531s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "cinder-quobyte-c92c75e8-4141-4f2b-b3dd-de200d23be66" acquired by "delete_volume" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0894948-9c8e-4d5d-8ea5-b9d8245f2227]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:11 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:11 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 Jul 21 08:29:11 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.432s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 Jul 21 08:29:12 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:12 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:29:12 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108" returned: 0 in 0.270s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d6f02f-7d52-406e-b71c-9bfecbaf820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf39c7e6-8e1c-443b-9461-a82b60343108', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6e40b5-b4b5-4c88-a3c5-d1a63944f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:12 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Volume volume-bf39c7e6-8e1c-443b-9461-a82b60343108 (bf39c7e6-8e1c-443b-9461-a82b60343108): created successfully Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6e40b5-b4b5-4c88-a3c5-d1a63944f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (4c79532e-ea51-4a2f-8ffa-64424848d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-cd951ea1-4195-4a0f-9a2c-765716485d11 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:29:12 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66" returned: 0 in 0.406s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:12 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66 Jul 21 08:29:12 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.376s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:12 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee Jul 21 08:29:12 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-c92c75e8-4141-4f2b-b3dd-de200d23be66" returned: 0 in 0.237s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "cinder-quobyte-c92c75e8-4141-4f2b-b3dd-de200d23be66" released by "delete_volume" :: held 0.687s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Created reservations ['4da5ebc9-b312-436c-b3d0-b7fc6aae2d65', '8e268c31-861b-4eb2-8321-eb4ba587150e', '543b0f14-21d4-42b6-afb7-5c180e075f32', 'f57b6973-c863-43e2-850e-e55197416771'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:12 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961.8f35743b-eb2d-4349-a985-67beb6947aee" returned: 0 in 0.287s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:12 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-8f35743b-eb2d-4349-a985-67beb6947aee" released by "_delete_snapshot" :: held 1.594s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" released by "delete_snapshot" :: held 1.618s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Created reservations ['bfa4c46b-04fc-4608-975a-1e740d18a0ae', '9bb579b1-0772-4d23-8b18-df14ad15a922', 'b63d8678-9ada-4118-851a-40a549618fb6', '95a737f7-9abd-4416-82e9-6da26829a0eb'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Delete snapshot completed successfully. Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-faf40886-c159-422c-9a7a-5b30961f13b4 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-8f35743b-eb2d-4349-a985-67beb6947aee-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:12 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.253s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:12 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:12 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Deleted volume successfully. Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-10b12fe6-c409-4d05-8737-89bb24d30bd5 tempest-ProjectReaderTests-1562816959 None] Lock "cinder-c92c75e8-4141-4f2b-b3dd-de200d23be66-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-4b310c47-9862-4e6d-b76e-f4bb3ded7961-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-4b310c47-9862-4e6d-b76e-f4bb3ded7961-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" acquired by "delete_volume" :: waited 0.026s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3974d1cb-9f4b-4972-8891-48568494cd97]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Flow 'volume_create_manager' (b467b49c-7164-4658-b47d-ffa45c22be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b188c09-a4fd-4821-b740-9ef143a489db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b188c09-a4fd-4821-b740-9ef143a489db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363802679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebdfbc4-8a37-4050-87f9-0061d4678c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b8ea4c76d54e97baf894f276a1f00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:13Z,use_quota=True,user_id='762dbf628fc74d74b22afa5a33279a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d5fad-030f-4e2d-a093-d6b8b80c27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d5fad-030f-4e2d-a093-d6b8b80c27bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbdef9b-e85f-4e78-a396-aec771b2332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbdef9b-e85f-4e78-a396-aec771b2332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebdfbc4-8a37-4050-87f9-0061d4678c5f', 'volume_name': 'volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23fe14d-e13e-4849-9082-5d6a1bfcbb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23fe14d-e13e-4849-9082-5d6a1bfcbb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:13 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:29:13 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537f089-d429-43e8-960c-1f197b5bad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:13 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Volume 6ebdfbc4-8a37-4050-87f9-0061d4678c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f', 'volume_size': 1} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363802679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebdfbc4-8a37-4050-87f9-0061d4678c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b8ea4c76d54e97baf894f276a1f00c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:13Z,use_quota=True,user_id='762dbf628fc74d74b22afa5a33279a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Creating volume 6ebdfbc4-8a37-4050-87f9-0061d4678c5f {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:29:13 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:13 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f 1073741824 Jul 21 08:29:13 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:13 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.366s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:13 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:13 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961 Jul 21 08:29:13 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f 1073741824" returned: 0 in 0.422s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:14 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-4b310c47-9862-4e6d-b76e-f4bb3ded7961" returned: 0 in 0.255s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f Jul 21 08:29:14 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-4b310c47-9862-4e6d-b76e-f4bb3ded7961" released by "delete_volume" :: held 0.695s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Created reservations ['8460ded9-1fcc-49f1-89b9-8c1c1ca5d92b', '614a8503-53bf-4b7c-ba52-48d0a3e557d9', 'e3ad5210-1efe-4915-99fe-9d64b5c7e2a5', '60cc4a19-fba2-4cdf-9be4-1943f6cfb575'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:14 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:14 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" returned: 0 in 0.261s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.688s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 25299929-7d46-4dc9-a7df-a4735c53aaa1 of volume bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1537f089-d429-43e8-960c-1f197b5bad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a95a607-8882-412b-a21a-58dd4d33c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e2177-852c-4129-8c6d-dcf2c9bc8e12]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:14 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Volume volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f (6ebdfbc4-8a37-4050-87f9-0061d4678c5f): created successfully Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a95a607-8882-412b-a21a-58dd4d33c031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Flow 'volume_create_manager' (b467b49c-7164-4658-b47d-ffa45c22be76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-3fa208f6-6904-4308-9372-6683e5d79e06 tempest-ProjectReaderTests-1562816959 None] Created volume successfully. Jul 21 08:29:14 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 Jul 21 08:29:14 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.273s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:14 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Deleted volume successfully. Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-98fb7d55-ce20-489e-8bb7-ece3302fd107 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-4b310c47-9862-4e6d-b76e-f4bb3ded7961-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-7d98ac56-3800-49a0-8eaa-069bc21c1589-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-7d98ac56-3800-49a0-8eaa-069bc21c1589-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" acquired by "delete_volume" :: waited 0.012s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f577f5-9a93-4001-8f42-8e59d8d35e4e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:14 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 Jul 21 08:29:14 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108" returned: 0 in 0.404s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:14 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 1G Jul 21 08:29:14 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:14 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589" returned: 0 in 0.368s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:14 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589 Jul 21 08:29:15 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:15 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 1G" returned: 0 in 0.396s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf39c7e6-8e1c-443b-9461-a82b60343108 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf39c7e6-8e1c-443b-9461-a82b60343108 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 Jul 21 08:29:15 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:15 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-7d98ac56-3800-49a0-8eaa-069bc21c1589" returned: 0 in 0.276s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-quobyte-7d98ac56-3800-49a0-8eaa-069bc21c1589" released by "delete_volume" :: held 0.696s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Created reservations ['d89d0c33-2a1e-4398-94bb-2d5cfb6c2c42', '9d6282b3-8fec-462a-a0b8-48c1621a1c67', 'b68f026c-8bcc-465d-bf8e-e20b964aaf58', 'd6e4ae46-d165-41e2-8139-1b9e9e4a28bc'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:15 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:15 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf39c7e6-8e1c-443b-9461-a82b60343108 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1" returned: 0 in 0.326s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:15 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 is being set with open permissions: ugo+rw Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 Jul 21 08:29:15 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Acquiring lock "cinder-6ebdfbc4-8a37-4050-87f9-0061d4678c5f-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "cinder-6ebdfbc4-8a37-4050-87f9-0061d4678c5f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Acquiring lock "cinder-quobyte-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "cinder-quobyte-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" acquired by "delete_volume" :: waited 0.038s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[3081acca-8516-4b43-b609-f38a130649d6]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:15 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Deleted volume successfully. Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-50aaf0c2-e120-44f2-9fe4-10910390f3c6 tempest-SnapshotDependencyTests-150477753 None] Lock "cinder-7d98ac56-3800-49a0-8eaa-069bc21c1589-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:15 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1" returned: 0 in 0.316s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:15 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:15 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info Jul 21 08:29:15 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:15 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f Jul 21 08:29:15 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:16 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info" returned: 0 in 0.272s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:16 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info is being set with open permissions: ugo+rw Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:16 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" returned: 0 in 0.430s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:16 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info Jul 21 08:29:16 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:16 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f Jul 21 08:29:16 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:16 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.info" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:16 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" returned: 0 in 0.268s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "cinder-quobyte-6ebdfbc4-8a37-4050-87f9-0061d4678c5f" released by "delete_volume" :: held 0.752s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-d240df6c-2a7e-431f-9d8a-5d764162bf62 tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Created reservations ['c20ee148-a5a4-4df5-a249-351083f813ae', 'b40a4dc9-8cbb-40e1-9a2c-c693c2de5f2b', '6ea243ee-ff2b-473b-9acd-aa64a6231a3e', 'e317f8a8-7820-4f78-81c3-858511e3a2f2'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:16 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:16 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-25299929-7d46-4dc9-a7df-a4735c53aaa1-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:16 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.339s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-25299929-7d46-4dc9-a7df-a4735c53aaa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:16 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Deleted volume successfully. Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-25299929-7d46-4dc9-a7df-a4735c53aaa1" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-5a4491c2-cab6-40d0-8413-f65a5faece4a tempest-ProjectReaderTests-1562816959 None] Lock "cinder-6ebdfbc4-8a37-4050-87f9-0061d4678c5f-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-25299929-7d46-4dc9-a7df-a4735c53aaa1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:16 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 25299929-7d46-4dc9-a7df-a4735c53aaa1 of volume bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ef6a1-0158-43b3-ab71-be25fd708d3c]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:17 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 Jul 21 08:29:17 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:17 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1" returned: 0 in 0.416s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf39c7e6-8e1c-443b-9461-a82b60343108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc15ccd-f428-450f-bc69-4b319b2600f0]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:17 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 Jul 21 08:29:17 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:17 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108" returned: 0 in 0.405s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:17 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:17 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 Jul 21 08:29:17 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:18 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1" returned: 0 in 0.394s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:18 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1 Jul 21 08:29:18 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:18 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108.25299929-7d46-4dc9-a7df-a4735c53aaa1" returned: 0 in 0.314s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-25299929-7d46-4dc9-a7df-a4735c53aaa1" released by "_delete_snapshot" :: held 1.649s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" released by "delete_snapshot" :: held 1.682s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Created reservations ['7f2f2615-4841-42cc-8854-46ffaf0f89a7', '75086015-25ef-48b5-a4b8-bf0d669d876a', 'cbe6e542-9ae9-46e0-86cc-781de1a25d37', '942d0bed-f0cb-4a12-8795-83b6cdcf7b32'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:18 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:29:18 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c67ee5ba-16c4-4540-906b-968d462106b2 tempest-ProjectMemberTests-159017781 None] Lock "cinder-25299929-7d46-4dc9-a7df-a4735c53aaa1-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-bf39c7e6-8e1c-443b-9461-a82b60343108-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "cinder-bf39c7e6-8e1c-443b-9461-a82b60343108-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" acquired by "delete_volume" :: waited 0.017s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98f043c-9308-46c8-89ad-db4ee3557550]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:19 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 Jul 21 08:29:19 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:19 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108" returned: 0 in 0.418s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:19 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108 Jul 21 08:29:19 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:19 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-bf39c7e6-8e1c-443b-9461-a82b60343108" returned: 0 in 0.288s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-bf39c7e6-8e1c-443b-9461-a82b60343108" released by "delete_volume" :: held 0.775s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:19 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Created reservations ['9f79f392-650e-4ebe-add4-70935b138725', '62903d3e-48bc-4781-b7a0-019acf5359c5', '87e255f0-c523-4c13-aa87-bbeb33db367a', '4dc459f4-9c17-4dc2-b183-7d1cc4f197b4'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:20 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:20 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:20 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.244s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:20 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-c88f5b08-e83f-4dda-ac5e-e4b38662cf6c tempest-ProjectMemberTests-159017781 None] Lock "cinder-bf39c7e6-8e1c-443b-9461-a82b60343108-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87372) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (25c6fe8a-140a-49c3-a635-e632a2077622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be2a4d1-8934-4389-bad8-35d63c255d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be2a4d1-8934-4389-bad8-35d63c255d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47910320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e6bafd-5536-4be8-ac2e-dca7267488c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:21Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459d12db-875b-45cf-8a0d-c559666bdee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459d12db-875b-45cf-8a0d-c559666bdee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d7e336-494d-4a72-886f-ae4a029da644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d7e336-494d-4a72-886f-ae4a029da644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e6bafd-5536-4be8-ac2e-dca7267488c7', 'volume_name': 'volume-77e6bafd-5536-4be8-ac2e-dca7267488c7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c468c0-48d0-4628-bfd7-bc2e7e14adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c468c0-48d0-4628-bfd7-bc2e7e14adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad8f4ed-8721-4e4c-b535-ab07f1adb0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:20 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Volume 77e6bafd-5536-4be8-ac2e-dca7267488c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e6bafd-5536-4be8-ac2e-dca7267488c7', 'volume_size': 1} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-21T06:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47910320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e6bafd-5536-4be8-ac2e-dca7267488c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49871d3981ea4df5b31f2b5fd2a59de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-21T06:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-21T06:29:21Z,use_quota=True,user_id='f8556ac174df4b72b6e46e7dfbba3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c39011-2c13-42af-b25b-48d039b80ed1),volume_type_id=d7c39011-2c13-42af-b25b-48d039b80ed1)}" {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Creating volume 77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Selected osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 as target Quobyte volume. {{(pid=87372) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 21 08:29:20 devstack cinder-volume[87372]: INFO cinder.volume.drivers.remotefs [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] casted to osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06 Jul 21 08:29:20 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 1073741824 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:20 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 1073741824 Jul 21 08:29:20 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:21 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 1073741824" returned: 0 in 0.455s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:21 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 Jul 21 08:29:21 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:21 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'} {{(pid=87372) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad8f4ed-8721-4e4c-b535-ab07f1adb0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e6bafd-5536-4be8-ac2e-dca7267488c7', 'volume_size': 1}' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3d8117-46c9-4c73-b9aa-2010a4ada271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 21 08:29:21 devstack cinder-volume[87372]: INFO cinder.volume.flows.manager.create_volume [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Volume volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 (77e6bafd-5536-4be8-ac2e-dca7267488c7): created successfully Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3d8117-46c9-4c73-b9aa-2010a4ada271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87372) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 21 08:29:21 devstack cinder-volume[87372]: DEBUG cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Flow 'volume_create_manager' (25c6fe8a-140a-49c3-a635-e632a2077622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87372) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 21 08:29:21 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-9b78e15f-16a8-48e2-a20a-2eab3d2f18a4 tempest-ProjectMemberTests-159017781 None] Created volume successfully. Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Creating offline snapshot 661bbc51-c7c6-4927-ba22-b227e5de5c9c of volume 77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[10806107-0dfe-45b7-aa61-7204921e8287]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:23 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 Jul 21 08:29:23 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:23 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7" returned: 0 in 0.388s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c 1G {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:23 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c 1G Jul 21 08:29:23 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:23 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c 1G" returned: 0 in 0.445s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:23 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:23 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c Jul 21 08:29:23 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:24 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 -F qcow2 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c" returned: 0 in 0.312s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c is being set with open permissions: ugo+rw Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:24 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c Jul 21 08:29:24 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:24 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c" returned: 0 in 0.251s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:24 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info Jul 21 08:29:24 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:24 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info" returned: 0 in 0.271s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:24 devstack cinder-volume[87372]: WARNING cinder.volume.drivers.remotefs [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info is being set with open permissions: ugo+rw Jul 21 08:29:24 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:24 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info Jul 21 08:29:24 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:25 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.info" returned: 0 in 0.250s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:25 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:25 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-e8eab194-c43c-4511-b033-2770922af16b tempest-ProjectMemberTests-159017781 None] Create snapshot completed successfully Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-661bbc51-c7c6-4927-ba22-b227e5de5c9c-delete_snapshot" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-661bbc51-c7c6-4927-ba22-b227e5de5c9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" by "delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-661bbc51-c7c6-4927-ba22-b227e5de5c9c" by "_delete_snapshot" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-661bbc51-c7c6-4927-ba22-b227e5de5c9c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Deleting offline snapshot 661bbc51-c7c6-4927-ba22-b227e5de5c9c of volume 77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] snapshot_file for this snap is: volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[98658272-cc3f-4ea1-8630-d977f3c3b11e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:26 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c Jul 21 08:29:26 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:26 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c" returned: 0 in 0.350s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.remotefs [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e6bafd-5536-4be8-ac2e-dca7267488c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87372) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c19cd9e-a6d7-4e07-bb64-451a268bb56e]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:26 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:26 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 Jul 21 08:29:26 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:27 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7" returned: 0 in 0.342s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:27 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c Jul 21 08:29:27 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:27 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c" returned: 0 in 0.329s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:27 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c Jul 21 08:29:27 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:27 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7.661bbc51-c7c6-4927-ba22-b227e5de5c9c" returned: 0 in 0.238s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-661bbc51-c7c6-4927-ba22-b227e5de5c9c" released by "_delete_snapshot" :: held 1.352s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" released by "delete_snapshot" :: held 1.373s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Created reservations ['c065fa74-f9c4-4ca1-9364-f25ebc3a7d2a', '22b893a3-1dea-4022-b27d-313e730228f3', 'cd909a99-9acb-4ec0-bad8-e50fadb7689f', '774c3297-d80e-4460-948d-28e5bd18d35c'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:27 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Delete snapshot completed successfully. Jul 21 08:29:27 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-db366f86-9da1-44fd-9dad-3ad783cfb91f tempest-ProjectMemberTests-159017781 None] Lock "cinder-661bbc51-c7c6-4927-ba22-b227e5de5c9c-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-77e6bafd-5536-4be8-ac2e-dca7267488c7-delete_volume" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "cinder-77e6bafd-5536-4be8-ac2e-dca7267488c7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Acquiring lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" by "delete_volume" {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" acquired by "delete_volume" :: waited 0.013s {{(pid=87372) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030143e-7b56-4974-80f1-f9d9fb865e11]: (4, 'qcow2') {{(pid=88536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:28 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 Jul 21 08:29:28 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:28 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7" returned: 0 in 0.357s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:28 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:28 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7 Jul 21 08:29:28 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:29 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1/volume-77e6bafd-5536-4be8-ac2e-dca7267488c7" returned: 0 in 0.239s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "cinder-quobyte-77e6bafd-5536-4be8-ac2e-dca7267488c7" released by "delete_volume" :: held 0.651s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.quota [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Created reservations ['6ec0d284-7c18-4bd2-b389-b0e76d909fe7', '977954b3-451d-487b-bbd6-cab6f3bb4265', '5b6b72e6-3d19-4dd3-8256-59bff4714b1c', '5ba7c010-83ea-4db5-ae31-892af4af7873'] {{(pid=87372) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06': None} {{(pid=87372) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.volume.drivers.quobyte [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-61c26bd9-5126-4e5b-b274-fa1991916e06'] {{(pid=87372) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.lockutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87372) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 21 08:29:29 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1 Jul 21 08:29:29 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 21 08:29:29 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG oslo_concurrency.processutils [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fb61706f5344b2d994d87f5778d55f1" returned: 0 in 0.232s {{(pid=87372) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.manager [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Notifying Schedulers of capabilities ... {{(pid=87372) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 21 08:29:29 devstack cinder-volume[87372]: INFO cinder.volume.manager [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Deleted volume successfully. Jul 21 08:29:29 devstack cinder-volume[87372]: DEBUG cinder.coordination [None req-4a86faa6-84e8-48ec-a5e3-e9f5184ba8b3 tempest-ProjectMemberTests-159017781 None] Lock "cinder-77e6bafd-5536-4be8-ac2e-dca7267488c7-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87372) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 21 08:29:39 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:DELETE=10,cinder:UPDATE=95,cinder:INSERT=25,cinder:SELECT=74 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 21 08:29:39 devstack cinder-volume[87372]: DEBUG dbcounter [-] [87372] Writing DB stats cinder:SELECT=72,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87372) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}